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"CYCLE  TIME"  — 

A  MILITARY  IMPERATIVE  AS  WELL 

Dr.  Walter  B,  LaBerge 

Dean  Clubb,  President  of  the  Defense  Systems  of  Electronics  Group,  Texas 
Instruments,  Inc.,  makes  in  his  article,  beginning  on  page  175,  a  reasoned 
and  impassioned  plea  to  DoD  to  incentivize  its  defense  contractors  so  that 
“minimum  cycle  time”  and  integrated  development  can  become  the  primary 
criteria  in  defense  procurement  awards  and  in  performance  evaluation.  From 
Tl’s  commercial  experience,  where  he  feels  the  business  conditions  to  be 
quite  similar.  Dean  extrapolates  that  Defense  Procurement  emphasis  on 
“minimum  cycle  time”  and  Integrated  Product  Teams  can  produce  striking 
improvements  for  DoD  in  product  quality,  significant  reduction  in  product  cost, 
and  more  rapid  new  product  introduction. 


The  upper  management  in  the  Depart¬ 
ment  of  Defense  has  challenged  the 
acquisition  community  to  reduce 
cycle  time  by  at  least  50%  by  the  year 
2000.  However,  within  the  bowels  of 
DoD,  vested  interests  (that  are  responsible 
for  previous  piece-part,  sequential,  non- 
integrated  procurement  processes)  are 
now  developing  antibodies  to  fight  this 
threat  to  their  survival.  Skilled  in  this  sur¬ 
vival  adaptation,  these  bureaucratic  forces 
are  mutating  like  their  biological  viral 
equivalents  into  new  forms  both  impervi¬ 
ous  to  these  new  DoD  directives  and  yet 
maintaining  their  ability  to  impede  pro¬ 
cesses  like  those  proposed  by  Dean  Clubb. 
The  only  way  to  thwart  their  successful 
mutation  is  to  inject  as  many  as  possible 
strong  white  corpuscles  into  the  fray  so  as 


to  overwhelm  them  before  they  mutate. 
The  off-line  military  defense  establish¬ 
ment  is  giving  its  all  at  the  blood  bank, 
but  so  far  the  fighting  military  appear  not 
to  be  active  in  this  needed  blood  donation 
campaign. 

So  far  the  fighting  part  of  the  U.S.  mili¬ 
tary  have  viewed  all  this  cycle  time  dis¬ 
cussion  quite  passively,  seeing  it  as  part 
of  the  endless  chain  of  well-intended  at¬ 
tempts  by  new  administrations  to  do  bet¬ 
ter  than  their  predecessors  in  the  morass 
of  government  procurement.  So  far,  the 
fighting  military  have  not  seen  Dean 
Clubb’s  argument  for  “minimum  cycle 
time”  procurement  as  the  sine  qua  non  of 
their  military  capability.  If  the  senior  fight¬ 
ing  military  could  come  to  the  realization 
of  the  absolute  criticality  of  minimum 
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cycle  time  to  their  service’s  survival,  then 
perhaps  they  could  donate  their  energies 
and  overwhelm  the  antibodies  to  change 
before  they  develop  a  strain  completely 
impervious  to  minimum  cycle  time. 

It  is  the  intent  of  this  short  article  to  try 
to  convince  the  senior  fighting  military 
that  minimum  cycle  time  is  indeed  the  next 
best  thing  to  sliced  bread  from  the  fight¬ 
ing  man’s  perspective,  and  thereby  to  in¬ 
duce  strong  intervention  within  their  or¬ 
ganizations  to  assure  its  wholehearted 
adoption  throughout  their  services,  who 
in  the  end  execute  the  predominance  of 
defense  procurement. 

Military  Argument  For 
Minimum  Cycle  Time  Proeurement 

The  reason  for  strong  military  endorse¬ 
ment  of  minimal  cycle  time  is  a  military, 
not  a  financial,  one.  The  figures  of  merit 
of  minimal  cycle  time  probably  are  the 
differences  between  winning  and  losing 
wars,  not  the  savings  of  10-15%  in  pro¬ 
curement  costs. 

Current  lack  of  understanding  of  this 
absolutely  critical  phenomenon  lies  in  the 
roots  of  our  past  which  produced  a  require¬ 
ments  process  responsive  to  the  era  of 
Soviet  confrontation.  In  that  era,  the 
United  States  was  threatened  by  a  mortal 
enemy  with  sufficient  technical  ability  and 
resources  to  provide  a  broad  range  of  tech¬ 


nological  improvements  to  the  capabili¬ 
ties  of  their  forces.  Because  their  world 
of  technology  and  our  own  were  separate, 
we  were  poorly  equipped  to  know  in 
which  direction  they  were  going,  and  were 
therefore  obliged  to  follow  all  of  the  di¬ 
rections  that  we  suspected  that  they  might 
follow. 

In  that  era,  the  overwhelming  Soviet 
threat  to  our  national  interests  forced  us 
to  implement  a  requirements  process  that 
was  based  on  a  threat  model  of  an  un¬ 
known  but  competent  isolated  enemy.  The 
urgency  of  that  perceived  threat  obligated 
us  to  counter  with  an  extremely  broad- 
based  program  of  product  introduction,  no 
matter  what  the  impact  to  the  U.S. 
economy. 

Today,  things  are  quite  different.  The 
threat  today  is  much  more  sinister,  because 
it  is  for  the  most  part  optional.  The  United 
States  today  has  no  equivalent  of  the 
former  Soviet  threat  in  Central  Europe  on 
which  to  base  all  its  action,  nor  is  it  prob¬ 
able  that  there  will  be  an  equivalent  of  the 
attack  on  Pearl  Harbor,  which  in  1941  pre¬ 
cipitated  us  involuntarily  into  war  with  a 
major  power. 

Our  military  intervention  in  the  next  de¬ 
cade  will  necessarily  have  to  be  “one-off’ 
individual  decisions  made  by  the  Presi¬ 
dent  and  the  Congress  based  on  their  view 
of  the  importance  of  such  intervention 
compared  to  the  threat  to  the  lives  of 
American  personnel  involved.  Also,  today 
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our  financial  situation  is  quite  different 
from  that  of  the  years  of  the  Reagan  mili¬ 
tary  buildup.  We  probably  will  never  again 
in  our  productive  lives  see  the  procure¬ 
ment  budgets  of  those  now  bygone  years. 

Worse  yet,  no  longer  are  we  contend¬ 
ing  with  an  industrially  isolated  state  from 
whom  our  technology  advantages  could 
be  deprived  until  they  appeared  in  the 
field.  Now,  anything  we  intend  to  have  in 
advanced  military  technology  is  in  no  time 
available  to  everyone  else  who  hears  of 
our  interest.  This  technology  is  available 
from  friend  or  enemy,  through  third  par¬ 
ties  privy  to  our  best  technology.  The  prod¬ 
uct  applications  that  were  previously  un¬ 
available  to  our  enemies  now  is  instantly 
available  to  anyone  who  wants  it.  It  used 
to  take  our  former  Soviet  enemies  quite  a 
long  time  to  develop  weapons  by  them¬ 
selves.  Now  these  secrets  can  be  obtained 
far  more  quickly  from  our  friends  using 
technology  shared  by  the  multi-country 
industrial  consortia  around  the  world. 
Everyone — ourselves  and  our  enemies — 
can  and  do  react  quickly  to  technological 
changes. 

One  way  to  look  at  the  threat  to  our 
military  forces  today  is  that  at  least  for 
several  decades  there  will  be  no  long-term 
threat  and  that  the  short-term  threat  can¬ 
not  be  defined.  The  threat  will  be  differ¬ 
ent  from  every  one  of  our  enemies,  and 
the  threat  we  hold  for  each  of  them  will 
vary  depending  on  how  we  attempt  to  pos¬ 
ture  ourselves. 

In  our  open  post-Cold  War  society  our 
potential  enemies  can  see  what  we  are 
doing  to  improve  our  military  capability, 
and  they  can  straightforwardly  be  ex¬ 
pected  to  change  directions  to  thwart  us. 
(An  example  might  be  the  upgunning  we 
now  contemplate  in  any  future  U.S.  Main 


Battle  Tank  (FMBT).  If  we  go  for  a 
140mm  gun  as  a  main  armament,  that’s 
the  way  the  enemy  can  go,  delayed  only 
by  the  time  needed  to  copy  the  broadly 
available  technology.  If  an  enemy  sees  us 
decide  on  rockets  for  main  armament  of 
an  FMBT,  then  it  will  either  copy  that  up¬ 
grade  or  procure  a  defensive  system  based 
on  the  same  generation  of  technology. 

The  real  threat  to  the  defeat  of  U.S. 
forces  in  this  era  is,  to  use  the  commercial 
terms,  potential  dominance  in  product 
cycle  time  by  our  potential  enemies.  All 
our  enemies  need  to  do  is  to  be  able  to 
adapt  our  current  technology  to  the  par¬ 
ticular  circumstances  of  their  operational 
environment  faster  than  we  can  learn  what 
they  are  up  to  and  respond  with  improve¬ 
ments  that  vitiate  their  actions.  If  we  can’t 
do  that,  we  are  probably  never  going  to 
deploy  our  forces.  And  if  that  happens, 
U.S.  military  forces  will  have  been  thor¬ 
oughly  defeated,  although  it  may  never 
show  as  such  on  history’s  scoreboard. 

Our  only  hope  is  to  be  the  winner  in  a 
“cycle  time  race,”  where  unfortunately  our 
enemies  have  the  advantage  of  access 
through  our  open  society  to  our  technol¬ 
ogy.  Our  only  hope  in  this  unpredictable 
new  world  is  to  prepare  technologically 
for  everything  an  enemy  might  decide  to 
do,  but  because  of  our  uncertainty  and  fi¬ 
nancial  limitations  build  very  little  for  the 
field  until  we  know  what  is  going  to  be 
needed,  and  then  to  build  it  lickety-split. 

Building  things  lickety-split  is  the  sine 
qua  non  of  what  Dean  Clubb’s  paper  is 
all  about.  American  industry  has  for  a  de¬ 
cade  been  living  in  a  world  of  intense  com¬ 
petition  but  at  the  same  time  intense  tech¬ 
nological  sharing.  In  the  1980s  we  used 
to  get  our  clocks  cleaned  in  that  world, 
inventing  new  technology  that  others 
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could  copy  and  get  to  the  market  quicker 
than  we  could,  even  with  our  head  start. 
Now,  however,  with  Dean’s  minimum 
cycle  time  emphasis,  U.S.  industry  is  now 
beginning  to  regain  product  initiative  and 
is  winning  worldwide  product  acceptance 
in  the  auto,  communications,  computer, 
and  medical  equipment  industries. 

Dean  and  Texas  Instruments  have  had 
no  other  alternative  than  to  play  in  the  only 
commercial  game  available  to  them.  They 
cannot  sit  on  their  hands  and  continue 
product  strategies  that  no  longer  apply. 
The  alternative,  changing  with  the  times, 
is  that  no  one  will  use  their  products  in 
the  future  and  that  they  will  go  out  of  busi¬ 
ness.  That  is  not  at  all  different  from  the 
plight  of  U.S.  military  today. 

The  choice  for  the  fighting  military  is 
almost  equivalents  to  those  of  Texas  In¬ 
struments:  Get  with  minimum  cycle  time 
and  respond  to  the  marketplace,  or  get  out 
of  business  because  no  one  will  use  your 
products.  What  industry  calls  market  re¬ 
search  DoD  must  copy  with  its  intelli¬ 


gence  systems,  so  it  can  predict  correctly 
what  products  should  go  to  the  market¬ 
place.  In  periods  of  curtailed  investment 
in  the  business  world,  little  is  put  into  the 
market  that  the  public  cannot  be  expected 
to  need  and  therefore  buy.  The  same  is  in¬ 
evitably  the  case  for  defense  procurement. 

To  conclude  this  companion  piece  to 
Dean  Clubb’s  fine  article,  let  this  author 
advise  the  fighting  military  that  minimum 
cycle  time  is  of  extreme  importance  to 
their  future,  and  that  the  military  at  the 
highest  levels  must  actively  engage  in  tak¬ 
ing  on  the  reduced  cycle  time  challenge. 
Our  senior  military  must  fight  any  bureau¬ 
cracy  that  appears  to  thwart  things  crucial 
to  our  nation’s  defense.  Bureaucracies  are 
hard  to  change.  They  survive  because  they 
can  mutate  with  amazing  alacrity.  Unless 
the  senior  fighting  military  are  willing  to 
give  their  blood  to  this  worthy  cause,  they 
may  see  their  own  bureaucracy  defeat  a 
concept  of  the  greatest  importance  to  their 
future. 
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The  appointment  of  overall  system  architects  for  Department  of  Defense  (DoD) 
acquisition  programs,  preferably  as  leaders  of  Integrated  Product  Teams, 
would  ensure  design  flexibility,  provide  for  rapid  insertion  of  advanced 
technology,  enhance  system  functionality,  and  make  more  effective  tradeoffs 
between  cost  and  performance.  It  is  especially  critical  in  deveioping  weapons 
or  other  systems  that  must  be  integrated  into  an  existing  system  of  systems 
to  achieve  an  enhanced  synergistic  effect.  This  approach  also  facilitates 
development  processes  for  current  and  future  user  needs,  consideration  of 
a  full  range  of  design  alternatives,  and  testing  throughout  the  fuli  operational 
envelope. 


America’s  military-industrial  com¬ 
plex  evolved  over  five  decades  to 
support  the  defense  needs  of  a  na¬ 
tion  engaged  in  a  Cold  War.  With  the  end 
of  that  war,  government  and  industry  have 
been  forced  to  reorient  their  strategies,  pri¬ 
orities,  overall  industrial  base,  and  weapon 
systems  to  meet  the  military  requirements 
of  a  “Hot  Peace.”  Complicating  their  ef¬ 
forts,  the  American  public  remains  wary 
of  distant  low-intensity  conflicts  and  ex¬ 
hibits  little  tolerance  for  American  casu¬ 
alties.  Also,  Congress  increasingly  sees  the 
Pentagon  as  an  obstacle  astride  its  path  to 
a  balanced  budget.  These  concerns  dem¬ 
onstrate  the  need  to  develop  and  field  ad¬ 
vanced  technologies  to  increase  America’s 


warfighting  effectiveness  and  ultimately 
minimize  the  number  of  American  com¬ 
bat  casualties. 

Indeed,  the  program  manager  faces  new 
and  complex  challenges  for  systems  ac¬ 
quisition:  to  accelerate  the  development 
cycle,  deliver  affordable  systems,  and 
minimize  risks  by  integrating  new  tech¬ 
nology  when  it  arises.  Not  surprisingly, 
the  challenges  of  faster,  cheaper,  and  bet¬ 
ter!  do  not  always  nicely  dovetail.  Inte¬ 
gration  of  existing,  readily  available  com¬ 
ponents  into  “new”  systems  is  being  en¬ 
couraged  by  industry,  but  at  a  price.  Many 
defense  firms  are  now  shortchanging  long¬ 
term  technology  research  to  invest  in  pro¬ 
totypes  or  system  components  they  hope 
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will  meet  some  immediate  military  re¬ 
quirement.  A  barrage  of  information  about 
commercial-off-the-shelf  (COTS)  compo¬ 
nents  or  nondevelopment  items  (NDI) 
bombards  the  decision  maker  every  day. 
Program  managers,  sorting  through  these 
“solutions”  developed  with  private  sector 
dollars,  attempt  to  formulate  an  optimal 
combination  that  will  meet  their  needs  in 
the  most  cost-effective  manner. 

Acquisition  reform  is  under  way  to 
meet  these  challenges  while  leveraging  in¬ 
dustry  investment.  Government  attempts 
at  accelerating  the  usual  acquisition  cycle 
include  such  innovative  and  complemen¬ 
tary  measures  as  the  Advanced  Technol¬ 
ogy  Demonstrations  (ATDs)  and  the  Ad¬ 
vanced  Capability  Technology  Demon¬ 
strations  (ACTDs);  often  described,  re¬ 
spectively,  as  “technology  pushes”  and 
“military  need  pulls”  (Lynn,  1994).  Al¬ 
though  these  initiatives  promote  the  quick 
fielding  of  new,  militarily  useful  technolo¬ 
gies,  they  also  operate  outside  of  the  nor¬ 
mal  acquisition  process  and  have  not  yet 
addressed  the  issue  of  effectively 
transitioning  these  advanced  technologies 
into  either  category  of  large,  on-going 
weapons  procurement  programs  or  the 
many  existing,  complex  “systems  of  sys¬ 
tems”  that  support  entire  warfare  areas 
(Eisner,  1991,  1993). 

Compounding  this,  the  private  sector’s 
investment  in  staff,  facilities,  and  technol¬ 
ogy  for  research  is  increasingly  restricted 
to  the  perceived  niche  markets  of  each 
firm.  Today’s  potential  system  develop¬ 
ers  are  more  apt  than  not  to  identify  prob¬ 


lems  that  can  be  accommodated  by  those 
solutions  that  are  already  on  their  shelves 
or  technologies  integral  to  their  own  In¬ 
dependent  Research  and  Development 
(IRAD)  investments  when  peering 
through  this  lens.  Although  well-inten¬ 
tioned,  the  resulting  products  are  usually 
marketed  as  advanced  technology  inser¬ 
tion  to  complex  systems  of  systems — 
without  due  regard  for  the  appropriate  sys¬ 
tem  of  systems  architecture. 

A  program  manager  can  cope  or  even 
thrive  in  this  new  environment  by  using 
the  system  architect  to  achieve  a  level  of 
design  flexibility  that  will  allow  for  the 
rapid  insertion  of  advanced  technology, 
and  also  enhance  system  functionality  and 
performance.  The  system  architect  is  in¬ 
dependent  of  the  developer  or  contractor, 
and  is  well-positioned  to  monitor  the  mar¬ 
ginal  utility  of  the  new  or  upgraded  sys¬ 
tem  as  it  relates  to  the  effectiveness  of  any 
larger  “system  of  systems.”  Other  benefits 
of  this  approach  include  the  facilitation  of 
(a)  development  processes  for  both  cur¬ 
rent  and  future  user  needs,  (b)  consider¬ 
ation  of  a  full  range  of  design  alternatives, 
and  (c)  representative  testing  throughout 
the  full  operational  envelope  to  ensure  low 
risk. 

A  system  architect  naturally  comple¬ 
ments  the  system  developer,  much  like  the 
commercial  architect  complements  a 
builder.  The  system  architect  concept  also 
fits  naturally  into  the  Integrated  Product 
Team  approach  directed  by  the  Under  Sec¬ 
retary  of  Defense  (Acquisition  and  Tech¬ 
nology)  as  a  key  tenet  of  acquisition  re- 


Ronald  Luman  is  with  the  Appiied  Physics  Lab  of  Johns  Hopkins  University  and  Professor 
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form  (Under  Secretary  of  Defense,  1995; 
Secretary  of  Defense,  1995).  Further 
implementing  guidance  regarding  IPX 
structures  (USD[AT]  and  ASD[d],  1995) 
suggests  that  the  “Integrating  IPX”  chair¬ 
man  functions  as  the  system  architect.  Xo 
understand  the  role  of  the  system  archi¬ 
tect  and  its  potential  for  accelerating  the 
acquisition  cycle  and  advanced  technol¬ 
ogy  insertion,  it  is  necessary  to  review 
the  current  DoD  system  engineering 
process. 

Review  of  the 

Systems  Engineering  Process 


Xhe  discipline  of  systems  engineering 
is  an  integral  element  of  DoD  acquisition. 
Although  the  DoD  initiative  to  adopt  the 
best  commercial  practices  has  resulted  in 
cancellation  of  the  old  MIL-SXD-499 
(1974)  on  systems  engineering,  its  in¬ 
tended  successor  (MIL-SXD-499B,  1994) 
has  been  converted  to  a  commercial  stan¬ 
dard,  EIA/IS-632  (1994).  Managers  of 
major  government  acquisition  programs 
are  required  to  take  the  five-month  De¬ 
fense  Systems  Management  College 
(DSMC)  systems  engineering  manage¬ 
ment  curriculum  at  Fort  Belvoir,  VA  (De¬ 
partment  of  Defense,  1991  and  1995). 
Systems  engineering  will  remain  as  the 
foundation  of  acquisition  and  develop¬ 
ment,  lending  standardized  quality  to  the 
process,  and  providing 

...  a  comprehensive,  stmctured,  and 
disciplined  approach  for  all  life-cycle 
phases,  including  new  system  prod¬ 
uct  and  process  developments,  up¬ 
grades,  modifications,  and  engineer¬ 
ing  efforts  conducted  to  resolve  prob¬ 


lems  in  fielded  systems.  (EIA/IS- 

632,  1994,  p.  1) 

Xhe  basic  systems  engineering  process 
contains  four  activities,  applied  iteratively 
as  illustrated  in  Figure  1  (reproduced  from 
MIL-SXD-499B,  1994,  nearly  identical  to 
that  in  EIAyiS-632):  requirements  analy¬ 
sis,  functional  analysis/allocation,  synthe¬ 
sis,  and  systems  analysis  and  control.  Xhis 
process  is  generally  executed  by  agree¬ 
ment  between  two  parties:  the  tasking  ac¬ 
tivity  as  the  organization  requiring  the  tech¬ 
nical  effort  (i.e.,  program  manager),  and  the 
performing  activity  as  the  organization  do¬ 
ing  the  technical  effort  (e.g.,  system  devel¬ 
oper  or  prime  contractor). 

Systems  Engineering  Process  Input 

Generating  and  assembling  the  infor¬ 
mation  necessary  to  effectively  develop  a 
system  is  an  iterative  process.  In  theory 
the  tasking  activity  provides  the  perform¬ 
ing  activity  with  all  the  information  rel¬ 
evant  to  its  needs,  objectives,  require¬ 
ments,  measures  of  effectiveness  (MOEs), 
operating  environment,  constraints,  etc.  It 
then  directs  the  performing  activity  to 
consolidate  this  information  for  the 
government’s  review  and  approval  during 
the  requirements  analysis  phase.  Obvi¬ 
ously,  the  systems  engineering  process  re¬ 
quires  sufficient  detail  for  a  system  devel¬ 
oper  to  generate  a  realistic  proposal.  How¬ 
ever,  it  is  no  exaggeration  to  say  that  the 
government’s  initial  statement  of  mission 
need,  for  example,  can  consist  of  a  one- 
sentence  statement.  Hence  the  generation 
of  a  comprehensive  set  of  the  necessary 
inputs  is  an  iterative  process  involving 
both  the  tasking  activity  and  the  potential 
developers  themselves. 
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PROCESS  INPUT 

•  Cuctomtr  NMdt/ObJ«etlv»t/R«qulrtment« 

•  Motions 

•  MeMures  of  Effectivene** 

-  Envlronmont* 

-  Constraints 

•  Tschnology  Bss 

•  Prior  Outputs 

•  Program  Doelslon  Roqulrsmsnta^ 

•  RoquIrsmantsFromlbllorsd 

Spseifieatlons  and  Standard) 


Requirements  Analysis 

•  Anatyzs  Missions  &  Environments 

•  Identify  Functional  Requirements 

•  Define/Rafine  Performance  & 

Design  Constraint  Requirements  Jl 


Functional  Anaiysis/Alloeatlon 


•  Decompose  to  Lower4^el  Functions 

•  Allocate  Performance  &  Other  Limiting 
Requirements  to  Ail  Functional  Levels 

•  Define/Reflne  Functional  Interfaces  (Internal/External)] 

•  Deflne/Refine/Integrate  Functional  Architecture 
Dealfln  Loop 

T  /Synthesis 

I  •  Ttansform  Architectures  (Functional  to  PhysleaO 
4(^estlon  I  *  Define  Altemadve  System  Concepts 

Configuration  Items  &  System  Elements 

•  Define/Renne  Physical  Interfaces  (Internel/External)] 

•  Deflns  AHematlve  Product  &  Process  Solutions 


PROCESS  OUTPUT 


•  Decision  Data  Base 

•  Decision  Support  Data 

•  System  Functional  & 

Physical  Architectures 

•  Specification  &  Baselines 

*  Balanced  System  Solutions 


Figure  1.  The  Systems  Engineering  Process 


The  system  architect  should  be  a  key 
player  in  this  first  phase  of  system  devel¬ 
opment  as  part  of  the  tasking  activity,  of¬ 
fering  both  systems  engineering  and  pro¬ 
gram  management  perspectives.  Disci¬ 
pline  is  required  to  avoid  a  natural  ten¬ 
dency  to  solve  the  problem  before  it  is 
fully  formulated  (i.e.,  premature  move¬ 
ment  to  particular  solutions  must  be  re¬ 
sisted  in  the  interest  of  solving  the  correct 
problem). 

Requirements  Analysis 


The  primary  outputs  of  this  phase  are 
the  overall  functional  architecture  and  as¬ 
sociated  performance  requirements  that 
have  been  built  on  MOEs  provided  or  ap¬ 


proved  by  the  sponsor.  As  noted  above, 
MOEs  are  often  not  known  by  the  spon¬ 
sor  at  the  level  of  detail  necessary  to  de¬ 
termine  even  overall  requirements,  and 
must  be  developed  with  full  consideration 
given  to  mission  need,  operating  environ¬ 
ment,  achievable  technology,  and  sponsor 
objectives  and  constraints.  This  effort  re¬ 
quires  expertise  in  a  range  of  disciplines, 
from  concepts  of  operation  through  state- 
of-the-art  technology,  and,  increasingly,  a 
knowledge  of  the  performance  and  robust¬ 
ness  of  available  commercial  systems  as 
well.  Requirements  analysis  is  conducted 
iteratively  with  Functional  Analysis/Allo¬ 
cation  to  ensure  that  the  system’s  objec¬ 
tives  are  achieved  within  the  limits  of 
available  technology  and  resources. 

Moreover,  system  performance  require- 
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ments  “shall  consider  the  full  life  cycle 
envisioned  and  must  be  characterized  in 
terms  of  degree  of  certainty  in  their  esti¬ 
mate,  the  degree  of  criticality  to  system 
success,  and  their  relationship  to  other  re¬ 
quirements,  in  order  to  facilitate 
prioritization  of  requirements  during  trade 
studies  and/or  final  evaluation  of  alterna¬ 
tives  and  selection  of  the  system  design” 
(DoD,  1991).  Considerable  controversy 
exists  as  to  the  degree  of  flexibility  with 
which  “requirements”  are  to  be  treated, 
with  design-to-cost  approaches  requiring 
maximum  possible  flexibility. 

Functional  Analysis  and  Allocation 

In  this  phase,  the  system’s  functional 
architecture  is  developed  in  detail  suffi¬ 
cient  to  support  a  synthesis  of  alternatives. 
The  overall  functional  architecture  is  ana¬ 
lyzed  and  logically  sequenced,  with  in¬ 
puts,  outputs,  and  interface  requirements 
clearly  defined.  Levels  of  performance  are 
either  assigned  or  derived  for  each  func¬ 
tional  requirement  and  interface  so  that 
overall  performance  requirements  may  be 
traced  throughout  the  functional  architec¬ 
ture.  This  division  and  allocation  is  con¬ 
tinued  until  the  resulting  set  of  require¬ 
ments  is  defined  in  quantifiable  technical 
performance  measures  (TPMs)  or  go/no- 
go  criteria,  as  appropriate,  and  in  sufficient 
detail  to  be  used  as  design  criteria. 

Functional  analysis  and  allocation  gen¬ 
erally  does  not  have  one  “right”  solution, 
and  “optimal”  is  hard  to  define,  let  alone 
achieve.  Hence  this  phase  requires  the 
exercise  of  judgment  when  initially  allo¬ 
cating  performance  requirements  to  func¬ 
tional  elements.  Moreover,  flexibility  must 
be  maintained  to  allow  the  different  ap¬ 


proaches  arising  in  this  phase  of  develop¬ 
ment  to  be  considered  and  costed  out  by 
each  subsystem  activity  during  the  subse¬ 
quent  synthesis  phase.  For  example,  the 
allocation  of  an  overall  budget  of  accu¬ 
racy  errors  for  a  strategic  missile  system 
across  such  subsystem  activities  as  initial 
conditions,  in-flight  guidance,  re-entry 
body  deployment,  geodesy,  and  re-entry 
flight  dynamics  will  require  an  under¬ 
standing  of  the  disparate  technologies  and 
costs  associated  with  maximizing  sub¬ 
system  performance.  Successes  and  fail¬ 
ures  at  innovation  must  also  be  accommo¬ 
dated  through  an  iterative  process  that  can 
reach  all  the  way  back  to  requirements 
analysis.  Of  course,  it  gets  harder  to  ad¬ 
just  performance  (especially  in  functional 
allocations)  as  the  development  cycle 
progresses.  Not  only  is  it  more  costly  to 
accommodate  design  changes,  but  the  sys¬ 
tem  developer  grows  increasingly  reluc¬ 
tant  to  consider  changes  affecting  its  own 
costs  (and  profits),  even  when  it  may  be 
clear  that  the  system  would  better  meet 
mission  objectives  were  changes  made. 

Synthesis 


Synthesis  is  that  phase  of  development 
in  which  complete  alternative  system  de¬ 
signs  are  generated  in  an  iterative  fashion 
with  functional  analysis  and  allocation. 
Synthesized  designs  will  describe  the  en¬ 
tire  system,  including  the  interfaces  be¬ 
tween  internal  subsystems  or  components 
and  the  external  environment.  The  system 
designer  must  verify  that  alternatives  will 
satisfy  functional  and  performance  re¬ 
quirements  and  that  they  are  attainable 
within  estimated  risk  levels. 

As  previously  discussed,  there  is  cur- 
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rently  pressure  to  find  ways  of  using 
COTS  components  or  technology.  A 
COTS  solution  may  appear  to  be  so  simple 
that  a  sponsor  will  wish  to  interject  it  into 
the  process  as  his  own  system  alternative. 
Unfortunately,  an  often-overlooked  and 
certainly  unappreciated  risk  factor  is  the 
cost  required  to  integrate  various  COTS 
components  from  different  vendors  into  a 
cohesive  system  that  meets  requirements. 
Especially  misunderstood  are  unpredict¬ 
able  software  costs  required  to  achieve  ef¬ 
fective  interfaces  between  hardware,  soft¬ 
ware,  and  human  operators,  as  well  as  to 
produce  displays  and  features  customized 
to  the  needs  of  the  operational  user. 

Systems  Analysis  and  Control 


Systems  analysis  and  control  is  an 
overarching  activity  that  operates  concur¬ 
rently  with  the  iterative  processes  spanned 
by  requirements  analysis,  functional 
analysis  and  allocation,  and  synthesis  (Fig¬ 
ure  1).  It  covers  a  variety  of  analyses: 
tradeoff  studies,  effectiveness  assess¬ 
ments,  and  system  or  subsystem  design 
analyses  and  simulations  to  estimate 
progress  in  achievement  of  TPMs  and 
overall  requirements.  It  also  employs  sev¬ 
eral  control  mechanisms:  risk  manage¬ 
ment,  configuration  management,  data 
management,  and  various  technical  re¬ 
views. 

The  analyses  are  conducted  by  the  per¬ 
forming  activity.  The  control  activities  are 
generally  joint  endeavors  involving  the 
tasking  as  well  as  the  performing  activity 
(MIL-STD-499B,  1994;  EIA/IS-632, 
1994).  System  analysis  is  considered  more 
generally  in  a  later  section. 


Systems  Engineering  Process  Output 

The  systems  engineering  process 
should  produce  balanced,  feasible  system 
alternatives  or  solutions  and  a  decision 
database  that  includes  decision  support 
data,  system  architectures,  and  specifica¬ 
tions  and  design  baselines  from  which  the 
key  decisions  made  during  the  process  can 
be  reconstructed  and  justified  (MIL-STD- 
499B,  1994;  EIA/IS-632, 1994).  Aframe- 
work  and  procedure  for  evaluation  should 
also  be  established  from  which  the  final 
system  design  can  be  selected  by  the  spon¬ 
sor  (Eisner,  1988). 

What'S  Missing? 


Is  the  systems  engineering  approach 
which  we  have  just  reviewed  still  viable 
in  the  current  acquisition  reform  environ¬ 
ment?  Certainly  it  is  central  to  the  current 
acquisition  process,  which  is  universally 
regarded  as  needing  reform  and  accelera¬ 
tion.  Today,  the  acquisition  program 
manager’s  challenge  is  to  accelerate  the 
development  cycle,  reduce  costs,  and 
maintain  the  capability  to  insert  the  most 
advanced  technology  appropriate  for  the 
stated  need.  Is  the  system  engineering  pro¬ 
cess  part  of  the  problem? 

The  key  to  meeting  this  challenge  is 
found  in  the  system  analysis  and  control 
process,  in  which  complex,  highly  visible, 
and  continuing  technical  evaluations  are 
conducted.  These  evaluations  guide  deci¬ 
sions  regarding  the  design,  capabilities,  or 
selection  of  system  alternatives.  It  is 
here  that  the  systems  architect  may  pro¬ 
vide  objective  judgment  and  perspective 
to  ensure  a  successful  development  pro¬ 
cess. 
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Technical  evaluations  may  be  grouped 
by  function  into  four  categories: 

1 .  Evaluations  that  determine  basic  pa¬ 
rameter  values.  For  example,  a  tech¬ 
nical  evaluation  may  be  necessary  to 
determine  the  variation  of  an  inertial 
navigation  system’s  (INS)  heading 
gyro  drift  bias  as  a  function  of  plat¬ 
form  azimuth.  This  evaluation  may 
involve  calculations,  computer  simu¬ 
lations,  field  tests,  and  measurements 
(Pace,  1986). 

2.  Evaluations  that  determine  system 
performance.  A  system  performance 
evaluation  may  determine  the  overall 
INS  error  growth  as  a  function  of  time. 
The  resulting  tool  might  be  a  covari¬ 
ance  simulation.  Performance  analyses 
are  arguably  the  most  visible  type  of 
technical  evaluation,  and  can  be  the  pri¬ 
mary  factor  in  discriminating  between 
system  alternatives  (Atallah,  1993). 


3.  Evaluations  that  determine  opera¬ 
tional  effectiveness  by  considering 
mission-level  MOEs  as  a  measure  of 
the  system  performance.  In  our  ex¬ 
ample,  the  ballistic  missile  system 
accuracy  that  is  initialized  by  the  INS 
depends  on  the  accuracy  of  the  INS, 
which  may  be  dependent  upon  plat¬ 
form  azimuth. 

4.  Evaluations  that  address  concepts  of 
operation,  tactics,  or  strategy,  and  con¬ 
sider  how  the  system  will  be  used  to 
satisfy  mission  objectives.  Increas¬ 
ingly,  weapon  systems  must  be  inte¬ 
grated  into  a  larger,  extant  system  of 
systems.  The  difficult  analysis  that 
predicts  the  marginal  utility  of  the  new 
system  to  the  larger  system  of  systems 
is  often  overlooked. 

These  technical  evaluations  use  a  vari¬ 
ety  of  modeling  and  simulation  methods. 
Figure  2  displays  the  full  range  of  such 


Figure  2.  Modeling  Taxonomy 
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techniques  available  to  the  systems  ana¬ 
lyst  (Eisner,  1988;  Scotti,  1994).  However, 
it  is  the  quantitative  modeling  methods 
that  are  the  most  commonly  used  in  the 
systems  engineering  process.  Laboratory 
experiments,  field  tests,  and  operational 
data  from  military  exercises  are  important 
sources  of  validation  data  for  the  model¬ 
ing  and  simulation  processes. 

Effective  execution  of  the  system 
analysis  and  control  activity  through  ju¬ 
dicious  technical  evaluations  brings  the 
following  benefits  to  the  systems  engi¬ 
neering  process: 

•  generation  of  system  alternatives  (in¬ 
cluding  concepts  of  operation)  that 
may  more  effectively  or  efficiently 
achieve  the  sponsor’s  objectives; 

•  explicit  consideration  of  assumptions, 
uncertainties,  costs,  consequences, 
etc.; 

•  an  objective  framework  and  common 
basis  for  evaluating  system  alterna¬ 
tives  and  selection  of  a  preferred  al¬ 
ternative; 

•  improved  understanding  of  the  issues 
and  hence  better  understanding  on  the 
part  of  the  sponsor  and  ultimately  the 
system  users;  and 

•  improved  managerial  capabilities  for 
planning  and  administration  of  the 
system  life  cycle  (Miser  and  Quade, 
1985,  pp.  25-26). 

There  are,  however,  adverse  conse¬ 
quences  that  can  arise  from  dependence 
on  systems  analysis  beyond  the  level  ap¬ 
propriate  to  the  scale  of  the  problem: 


•  unwanted  delays  in  system  develop¬ 
ment; 

•  undesirable  centralization  and  con¬ 
centration  of  decision  making  in  top- 
level  staff; 

•  increased  dependence  on  complex 
processes  (e.g.,  simulation)  that  re¬ 
quire  expensive  talent  to  operate;  and 

•  loss  of  risk  mitigation  capability 
through  elimination  of  apparent  inef¬ 
ficiency  and  redundancy. 

A  system  developer  may  seek  to  avoid 
detailed  technical  evaluations,  citing  the 
potential  for  schedule  impact  as  a  justifi¬ 
cation.  This  position  may  also  be  moti¬ 
vated  by  a  lack  of  qualified  people  to  do 
the  evaluations,  or  concern  that  an  analy¬ 
sis  will  encourage  reconsideration  of  an 
alternative  already  effectively  discarded. 
However,  a  vibrant,  objective,  ongoing 
systems  analysis  is  essential  to  the  main¬ 
tenance  of  systems  perspective,  especially 
in  regard  to  the  “system  of  systems.”  The 
standard  systems  engineering  process  does 
not  address  this  overall  architecture  ques¬ 
tion,  generally  considering  the  system 
under  development  as  an  isolated  entity. 

Systems  Architecting 


A  broad  role  growing  out  of  systems 
analysis  and  control  in  the  systems  engi¬ 
neering  process  has  recently  been  charac¬ 
terized  as  system  architecting  (Rechtin, 
1991, 1994).  The  function  of  a  system  ar¬ 
chitect  is  to  act  as  the  system  development 
agent  of  the  program  manager,  to  create 
and  manage  the  design,  to  maintain  sys- 
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tem  integrity,  and  to  help  achieve  user  sat¬ 
isfaction  with  the  procured  system.  Hence 
it  is  a  role  that  exists  at  the  level  of  the 
acquisition  process,  yet  may  also  contrib¬ 
ute  to  the  engineering  of  a  system. 

The  discussion  of  systems  analysis  pre¬ 
sented  above  has  focused  on  tradeoff  stud¬ 
ies,  quantitative  technical  evaluations,  sys¬ 
tem  integration,  and  interface  manage¬ 
ment — all  within  the  context  of  the  sys¬ 
tems  engineering  process.  However,  the 
role  of  the  system  architect  goes  beyond 
systems  engineering  to  include  the  com¬ 
prehensive  synthesis,  certification,  and 
qualitative  satisfaction  of  user  needs — all 
of  which  are  goals  of  the  Integrating  IPX 
(USD[AT]  and  ASD[CT],  1995.  System 
architecting  applies  systems  analysis 
methodology  to  the  acquisition  process, 
rather  than  operating  strictly  within  the 
confines  of  the  single  systems  engineer¬ 
ing  process,  per  se. 


Another  way  to  understand  system 
architecting  is  to  contrast  its  tasks  with 
those  generally  performed  as  part  of  sys¬ 
tems  engineering.  Architecting  is  working 
for  the  program  manager  and  with  a  sys¬ 
tem  developer;  engineering  is  working 
with  an  architect  and/or  a  system  devel¬ 
oper.  In  short,  the  core  of  architecting  is 
system  integration  and  a  continuing  veri¬ 
fication  that  the  desired  product  is  being 
obtained.  Figure  3  illustrates  the  scope 
and  potential  value  added  by  the  archi¬ 
tect  throughout  the  life  cycle  of  the  sys¬ 
tem. 

The  military  has  long  recognized  the 
need  for  system  architects  in  the  acquisi¬ 
tion  process,  though  that  terminology  is 
not  widely  used  outside  of  the  software 
engineering  specialty.  The  term  technical 
direction  agent  (TDA)  reflects  a  role  simi¬ 
lar  to  what  we  have  discussed  for  the  sys¬ 
tem  architect: 
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The  TDA  assists  the  level  III  Sys¬ 
tem  Manager  in  the  establishment  of 
initial  program  concepts,  performs 
system  engineering,  develops  perfor¬ 
mance  specifications,  and  performs 
or  directs  research,  development,  test 
and  simulations  to  investigate  prob¬ 
lems,  probe  alternative  approaches, 
and  to  evaluate  design  agent  achieve¬ 
ments.  (Department  of  the  Navy, 
1985) 

To  summarize  the  role  of  the  system  ar¬ 
chitect,  it  will  help  to  define  some  terms: 

•  The  “system”  is  what  is  built. 

•  The  “model”  is  a  description  of  the 
system  to  be  built. 

•  The  “system  architecture”  is  the  struc¬ 
ture  of  the  system. 

•  The  “overall  architecture”  includes 
the  structure  not  only  of  the  system, 
but  of  its  functions,  the  environment 
within  which  it  will  operate,  and  the 
process  by  which  it  will  be  developed 
and  operated  (Rechtin,  1991,  p.  75). 

The  systems  architect  is  then  concerned 
with  the  overall  architecture,  not  just  the 
system  architecture,  the  model,  or  associ¬ 
ated  technical  evaluations. 

The  System  Architect  ih  the 

IHTEGRATED  PRODUCT  TEAM 


Increasingly  in  this  era  of  joint  and 
combined  operations,  systems  must 
interoperate  with  other  systems,  forming 
a  “system  of  systems”  that  offers  a  true 


warfighting  capability.  Hence  many  acqui¬ 
sition  programs  are  justified  and  judged 
on  their  marginal  utility  to  the  effective¬ 
ness  of  this  larger  “system  of  systems.” 
This  is  the  perspective  of  the  system  ar¬ 
chitect.  Furthermore,  the  Integrated  Prod¬ 
uct  Team  is  an  excellent,  cooperative  ve¬ 
hicle  that  can  easily  accommodate  estab¬ 
lishment  of  the  system  architect  as  the  in¬ 
tegrating  IPT  chairperson,  acting  as  the 
design  agent  of  the  program  manager.  De¬ 
pending  on  the  particular  program  and  the 
technical  knowledge  required,  the  system 
architect  role  may  be  satisfied  by  one  of 
the  following. 

1.  The  program  manager  or  his  or  her 
staff. 

2.  A  government  laboratory. 

3.  A  university  laboratory. 

4.  A  nondevelopment  division  of  a  sys¬ 
tems  contractor. 

Recalling  our  earlier  discussion  about 
industry  investments  and  COTS  technol¬ 
ogy,  it  is  critical  that  DoD  sponsors  have 
the  best  possible  perspective  and  knowl¬ 
edge  available  when  buying  in  the  tech¬ 
nological  marketplace.  This  must  be  pro¬ 
vided  with  a  competence,  integrity,  and 
objectivity  beyond  question.  It  is  not  rea¬ 
sonable  to  go  to  the  free  enterprise  mar¬ 
ketplace  from  which  the  government  will 
buy  its  systems  and  ask  for  advice  on 
which  systems  to  buy.  Conversely,  the 
system  architecting  organization  has  no 
potential  for  conflict  of  interest,  as  it  is 
not  a  candidate  to  develop  the  operational 
system,  though  it  may  well  build  proto¬ 
types  as  part  of  the  technical  evaluation 
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processes  described  above.  This  indepen¬ 
dence  from  the  business  of  operational 
system  development  and  production 
means  that  the  system  architect  doesn’t 
come  to  analysis  or  architecting  with  a 
particular  technology  or  system  solution 
in  mind.  Indeed,  the  architect  is  obligated 
to  table  the  sponsor’s  initial  agenda  or 
solution  (typically,  the  sponsor  has  one  in 
mind,  stated  or  not)  until  the  problem  is 
sufficiently  understood  and  structured. 

The  in-house  institutions  that  perform 
this  role  are  sometimes  referred  to  as  “re¬ 
search  and  development  centers”  and  take 
the  form  of  either  military  or  university 
laboratories.  These  laboratories,  and  the 
government,  realize  that  they  must  have 
full  knowledge  of  military  operations  and 
the  implications  of  technology,  which  can¬ 
not  be  gained  by  mere  observation.  In 
short,  they  train  to  be  system  architects, 
or  independent  systems  analysts  operat¬ 
ing  at  the  acquisition  level,  whose  role 
spans  the  full  spectrum  from  research  and 
development  through  operational  perfor¬ 
mance  evaluation  in  the  field  or  at  sea. 

Perhaps  the  strongest  argument  for  this 
independent  architecting  in  the  DoD  ac¬ 
quisition  process  is  that  it  can  reduce  cost 
and  improve  the  product  in  spite  of  gov¬ 
ernment  contracting  procedures.  To  illus¬ 
trate:  The  government  frequently  punishes 
a  contractor  more  severely  for 
underrunning  than  it  does  for  overrunning 
(Kershner,  1981).  This  is  an  almost  inevi¬ 
table  consequence  of  the  DoD  contract¬ 
ing  practice  for  systems  being  developed 
as  opposed  to  those  in  production.  In  the 
former  case,  the  contract  is  typically  of 
the  “cost  plus”  variety  because  the  costs 
of  development  are  too  uncertain  for  ei¬ 
ther  the  contractor  or  the  government  to 
agree  on  a  fixed  price.  Nevertheless,  the 


cost  and  schedule  estimates  generated  at 
the  start  of  a  program  will  form  the  basis 
for  significant  allocations  of  resources  and 
staff  to  which  the  contractor  and  the  gov¬ 
ernment  are  then  committed.  Consider, 
however,  how  this  may  affect  an  ongoing 
program  in  which  an  innovative  applica¬ 
tion  of  advanced  technology  might  halve 
the  remaining  cost  and  schedule  of  devel¬ 
opment.  This  innovation  may  create  a  con¬ 
flict  of  interest  for  the  contractor,  who  was 
counting  on  the  initially  agreed-on  fund¬ 
ing  and  schedule  to  gainfully  employ  sig¬ 
nificant  numbers  of  staff.  In  this  case  an 
independent  system  architect  could  be  re¬ 
lied  on  to  uncover  the  new  technology  ap¬ 
plication  and  present  it  to  the  system  de¬ 
veloper  and  sponsor. 

Situations  of  this  magnitude  are  rare, 
but  a  independent  system  architect,  work¬ 
ing  within  the  constructive  atmosphere  of 
the  Integrating  IPT,  can  make  significant, 
consistent  contributions  toward  integra¬ 
tion. 

Summary 


Systems  analysis  applied  to  the  acqui¬ 
sition  process,  sometimes  described  as 
system  architecting,  is  vital  to  successful 
development  of  complex  systems  and  sys¬ 
tems  of  systems.  The  architect  role  is  best 
performed  by  an  agent  of  the  government 
program  manager  (and,  thus,  independent 
of  the  system  developer)  who  can  be  re¬ 
lied  on  to  ensure  sponsor  satisfaction  with 
the  final  system.  The  accelerating  pace  of 
technology,  the  aggressive  investment  in 
and  marketing  of  components  and  systems 
by  the  private  sector,  and  the  increasing 
complexity  of  military  needs  all  mandate 
an  ever  more  sophisticated  government 
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consumer.  The  system  architect  must  of¬ 
fer  a  broad  expertise  in  the  state-of-the- 
art  technology,  information  systems,  and 
a  knowledge  of  mission  operational  needs, 
as  well  as  the  skill  to  apply  this  knowl¬ 
edge  in  a  cost-effective  manner. 

The  acquisition  program  manager  can 
maintain  this  vision  and  focus  by  appoint¬ 
ing  a  system  architect,  independent  from 


the  system  developer  or  contractor,  to 
chair  an  essential  Integrated  Product 
Team.  This  is  especially  critical  in  the  con¬ 
text  of  a  “system  of  systems”  development 
environment,  wherein  program  success 
will  ultimately  be  judged  on  the  marginal 
utility  of  the  new  or  upgraded  system  to 
the  entire  system  of  systems’  effective¬ 
ness. 
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DAWIA  AND  THE  PRICE  OF 
PROFESSIONALISM 


Keith  f,  Snider 

This  article  examines  the  intent  and  outcomes  of  the  Defense  Acquisition 
Workforce  Improvement  Act  (DAWIA)  in  light  of  research  literature  on  the 
sociology  of  the  professions.  It  indicates  that  professionalization  is  leading  to 
an  acquisition  workforce  that  is  expert  and  specialized,  yet  insular  and  careerist. 
Professionalism  thus  comes  at  a  price,  and  a  major  question  for  those  dealing 
with  acquisition  workforce  reform  issues  is  how  to  keep  this  price  as  low  as 
possible. 


Five  years  after  passage  of  the  Defense 
Acquisition  Workforce  Improvement 
Act  (DAWIA),  it  is  appropriate  to  ex¬ 
amine  the  act — its  intent,  provisions,  and 
outcomes — in  some  perspective.  Scholars 
(e.g..  Fox,  1974, 1988),  presidential  com¬ 
missions  (e.g..  President’s  Blue  Ribbon 
Commission  on  Defense  Management, 
1986),  and  Congressional  committees 
(e.g.,  U.S.  Congress,  House,  1990b)  alike 
have  devoted  considerable  study  to  the 
topic  of  workforce  reform.  Yet  the  need 
for  additional  study  remains  as  new  legis¬ 
lation  is  aimed  at  the  acquisition  workforce 
(U.S.  Congress,  Senate,  1995),  and  as  cur¬ 
rent  trends  toward  “downsizing,” 
“rightsizing,”  reengineering,  and  reinvent¬ 
ing  continue  into  the  future. 

The  subject  of  this  paper  may  be  intro¬ 
duced  with  an  anecdote  from  the  author’s 
experience  in  teaching  portions  of  Defense 


Acquisition  University  (DAU)  courses.  At 
the  beginning  of  one  recent  course,  stu¬ 
dents  introduced  themselves  and  ex¬ 
plained  their  reasons  for  attending.  One 
might  have  expected  that  these  relatively 
senior  civil  servants  and  military  officers 
would  cite  reasons  relating  to  professional 
education  and  personal  development. 
Without  fail,  however,  most  students  gave 
a  reason  that  smacks  of  the  self-serving 
careerism  known  as  “ticket  punching:”  to 
obtain  the  certification  for  training  re¬ 
quired  as  a  result  of  DAWIA. 

This  apparently  careerist  frame  of  mind 
in  our  acquisition  workforce  should  not 
surprise  us.  A  significant  body  of  research 
concerning  the  sociology  of  the  profes¬ 
sions  indicates  that  this  is  an  entirely  pre¬ 
dictable,  albeit  unintended,  consequence 
of  DAWIA.  Some  of  this  research  explores 
the  prestige  and  competency  aspects  of 
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professions  and  may  be  useful  in  under¬ 
standing  the  intent  of  DAWIA.  Another 
more  critical  area  of  the  research  focuses 
on  what  happens  to  occupations  as  they 
become  professionalized;  that  is,  as  they 
gain  professional  status.  Profession¬ 
alization  is  generally  seen  as  a  positive 
movement  in  the  direction  of  improving 
the  quality  and  status  of  an  occupation, 
but  research  also  reveals  unintended  con¬ 
sequences  of  professionalization  that  op¬ 
pose  the  outcomes  intended  by  those  seek¬ 
ing  such  status.  Probably  the  most  obvi¬ 
ous  example  of  the  unintended  conse¬ 
quences  of  professionalization  is  provided 
by  the  legal  profession,  once  highly  re¬ 
spected  in  American  society,  but  now  of¬ 
ten  criticized  for  being  insular  and  self- 
serving. 

Professionalism  thus  comes  at  a  price. 
This  paper  will  review  the  research  litera¬ 
ture  to  expose  and  explore  that  price:  the 
“dark  side,”  so  to  speak,  of  acquisition 
workforce  professionalization.  It  will  re¬ 
veal  the  essentially  problematical  nature 
of  professionalization,  thereby  question¬ 
ing  DAWIA’s  assumptions  about 
workforce  improvement  leading  to  reform 
of  the  overall  acquisition  environment. 

AnRiBUTE  Models: 

Capturing  the  Intent  of  DAWIA 

Occupations  and  professions  became 
important  subjects  of  sociological  research 
during  the  first  part  of  this  century  as  sci¬ 


entific  and  technological  advances  led  to 
an  ever-increasing  level  of  diversification 
and  specialization  in  the  workforce. 
Emerging  occupations  sought  the  same 
level  of  prestige  accorded  the  four  tradi¬ 
tionally  recognized  professions:  law, 
medicine,  the  ministry,  and  university 
teaching  (Etzioni,  1969).  The  aspect  of 
prestige  is  evident  in  this  classical  defini¬ 
tion  of  the  word  profession: 

Profession:  a  calling  requiring  spe¬ 
cialized  skills  and  methods  as  well 
as  in  the  scientific,  historical,  or 
scholarly  principles  underlying  such 
skills  and  methods,  maintaining  by 
force  of  organization  or  concerted 
opinion  high  standards  of  achieve¬ 
ment  and  conduct,  and  committing 
its  members  to  continued  study  and 
to  a  kind  of  work  which  has  for  its 
prime  purpose  the  rendering  of  a 
public  service.  (Webster’s  Third  New 
International  Dictionary,  1961) 

From  this  classical  perspective,  certain 
qualities  are  attributed  to  professions 
(Pavalko,  1988): 

( 1 )  A  unique  knowledge  base  justifying 
the  claim  to  special  expertise. 

(2)  A  long  training  period  requiring  spe¬ 
cialized  knowledge  and  indoctrina¬ 
tion  into  the  occupational  subculture. 

(3)  Relevance  of  work  to  social  values. 
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(4)  A  service  versus  a  profit  motivation. 

(5)  Occupational  autonomy.  The  profes¬ 
sion  is  self-regulating  and  self-con¬ 
trolling.  Only  members  of  the  pro¬ 
fession  judge  and  certify  who  is  com¬ 
petent  to  practice. 

(6)  A  strong  sense  of  commitment  and 
loyalty  to  the  profession. 

(7)  A  strong  sense  of  a  common  identity 
resulting  in  a  significant  subculture. 

(8)  A  code  of  ethics  and  system  of  norms 
that  are  parts  of  the  subculture,  rein¬ 
forcing  motivation,  autonomy,  and 
commitment. 

Because  of  these  attributes,  professions 
are  perceived  to  exhibit  that  high  quality 
of  work  in  terms  of  requisite  expertise, 
experience,  and  dedication  to  service 
which  justifies  public  trust  and  respect. 
Early  research  in  the  sociology  of  the  pro¬ 
fessions  documented  these  attributes  and 
the  associated  quest  among  emerging  oc¬ 
cupations  to  gain  the  status  of  professions 
by  taking  on  their  attributes.  For  example, 
caseworkers  led  the  move  during  the 
1920s  to  establish  formal  training  pro¬ 
grams  leading  to  certification  in  the  bud¬ 
ding  field  of  social  work  (Larson,  1977). 

The  attribute  models  of  the  professions 
are  useful  in  understanding  the  putative 
intent  of  DAWIA,  as  reflected  in  the  title 
of  a  National  Contract  Management  Jour¬ 
nal  article,  “Creating  a  Professional  Ac¬ 
quisition  Workforce,”  by  former  Con¬ 
gressman  Nicholas  Mavroules  (1991),  one 
of  the  architects  of  DAWIA.  Nothing  in 
his  article,  in  the  text  of  the  legislation,  or 
in  the  record  of  relevant  Congressional 


hearings  (U.S.  Congress,  House,  1990a) 
indicates  an  explicit  intent  to  establish  the 
field  of  acquisition  as  a  profession  per  se. 
Nevertheless,  the  goals  of  making  the  ac¬ 
quisition  workforce  professional  and  of  in- 
creasing  the  professionalism  of  the 
workforce  are  clear. 

One  need  not  belong  to  a  profession  in 
order  to  be  professional  or  to  exhibit  pro¬ 
fessionalism.  Yet  these  words  refer  to  and 
take  the  power  of  their  meaning  from  the 
high  classical  concept  of  profession  as 
reflected  in  the  attribute  model.  To  be  pro¬ 
fessional  or  to  have  professionalism  means 
therefore  to  act  as  though  one  belonged  to 
an  occupation  with  at  least  some  of  the 
attributes  of  the  traditional  professions. 

The  intent  of  DAWIA  is  to  make  mem¬ 
bers  of  the  acquisition  workforce  profes¬ 
sional  by  treating  them  as  though  acquisi¬ 
tion  has  some  of  the  attributes  of  a  pro¬ 
fession.  Specifically,  acquisition  is  seen 
as  possessing  the  attributes  of  a  unique 
knowledge  base  requiring  extended  train¬ 
ing  and  experience.  The  workforce  then 
becomes  professional  by  meeting  the  re¬ 
quirements  for  acquisition  education, 
training,  experience,  and  tenure  provided 
for  under  DAWIA. 

A  brief  discussion  of  how  this  relates 
to  some  military  members  of  the  acquisi¬ 
tion  workforce  will  illustrate  this  point 
further.  Some  sociologists  (e.g.,  Jackson, 
1970)  include  the  military  as  one  of  the 
traditional  professions.  Indeed,  the  “pro¬ 
fession  of  arms”  fits  the  attribute  model 
well.  It’s  also  tme  that  the  warrior’s  unique 
knowledge  and  skills  in  the  art  and  sci¬ 
ence  of  war  are  valued  in  the  field  of  ac¬ 
quisition,  particularly  in  understanding  the 
operational  use  of  equipment  under  de¬ 
velopment  (U.S.  Congress,  House,  1990a, 
p.  184).  But,  as  Kronenberg  (1990,  p,  286) 
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points  out,  the  warrior  orientation  does  not 
easily  accommodate  itself  to  the  complexi¬ 
ties  of  management  in  the  Department  of 
Defense  (DoD).  Professional  warriors  are 
often  seen  as  amateurs  in  acquisition: 

...  the  Army,  the  Navy,  and,  to  a  lesser 
extent,  the  Air  Force  provide  only  lim¬ 
ited  industrial  management  training  for 
military  officers  whom  they  assign  to 
key  managerial  positions  in  major  ac¬ 
quisition  programs.  Army  and  Navy 
officers  assigned  to  acquisition  pro¬ 
grams  often  have  extensive  combat 
arms  experience  (e.g.,  as  pilots,  ship 
captains,  armor  commanders)  but  little 
or  no  advanced  training  and  experi¬ 
ence  in  the  planning  and  control  of  in¬ 
dustrial  development  and  production 
programs.  (Fox,  1988,  pp.  40-41) 

The  implicit  views  expressed  here  are: 
first,  that  acquisition  has  the  attributes  of 
a  unique  knowledge  base  requiring  exten¬ 
sive  training  and  experience;  and  second, 
that  the  skills  and  training  of  the  profes¬ 
sional  warrior — the  pilot,  the  ship  captain, 
and  the  armor  commander — are  inad¬ 
equate  for  tasks  in  acquisition. 

Further  supporting  this  view  that  mili¬ 
tary  members  are  not  professionals  in  ac¬ 
quisition  has  been  the  practice  of  the  mili¬ 
tary  services  to  rotate  officers  frequently 
in  and  out  of  key  positions  (Kronenberg, 
1990,  p.  286).  This  environment  in  which 
military  amateurs  hold  key  acquisition  po¬ 
sitions  is,  according  to  Mavroules  (1991, 
p.  15),  one  of  the  root  causes  of  the 
nation’s  continuing  acquisition  problems. 

DAWIA  aims  to  correct  this  situation. 
It  recasts  warriors  as  acquisition  profes¬ 
sionals  by  requiring  them  to  undergo  edu¬ 
cation  and  training  in  acquisition,  to  de¬ 


vote  perhaps  most  of  their  careers  to  jobs 
in  acquisition,  and  to  forego  more  frequent 
career-broadening  rotations  in  favor  of 
longer  tenure  and  stability  in  key  acquisi¬ 
tion  positions.  These  requirements  will  in¬ 
evitably  force  young  officers  to  choose 
early  in  their  careers  whether  to  proceed 
as  warriors  or  as  acquisition  profession¬ 
als,  because  the  training  and  experience 
necessary  to  do  both  successfully  is  sim¬ 
ply  too  extensive.  DAWIA  encourages 
such  an  early  decision  toward  a  career  in 
acquisition  by  requiring  that  paths  be  iden¬ 
tified  for  officers  to  progress  from  entry 
level  all  the  way  to  the  most  senior  acqui¬ 
sition  positions. 

Similarly,  the  acquisition  workforce  as 
a  whole,  through  compliance  with  educa¬ 
tion,  training,  experience,  and  tenure  re¬ 
quirements,  is  made  professional  and  im¬ 
proved,  reflecting  the  quality  associated 
with  the  classical  view  of  the  professions. 
The  intent  of  DAWIA  is  thus  consistent 
with  the  Total  Quality  Management 
(TQM)  view  that  investments  in  employ¬ 
ees  are  investments  in  agency  capacity 
(Lane  and  Wolf,  1990,  pp.  83-84;  White 
and  Wolf,  1995,  p.  213).  The  expectation 
is  that  the  return  on  these  investments  in 
the  workforce  will  be  improvements  in  the 
processes  of  acquisition.  According  to 
Mavroules  (1991,  p.  16),  “more  qualified 
people  should  make  for  a  more  efficient 
acquisition  system  that  will  give  us  more 
bang  for  the  buck.” 

Of  course,  not  everyone  agrees  that 
such  an  investment  is  appropriate.  Some 
believe  that  the  nature  of  defense  acquisi¬ 
tion  is  such  that  no  professional  skills  are 
required.  Former  Office  of  Personnel 
Management  associate  director  Terry 
Culler  ( 1 986,  p.  32)  argues  that  a  civil  ser¬ 
vant  with  any  more  than  an  acceptable 
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level  of  competence  is  overskilled  and 
overqualified  for  government  service.  The 
government  cannot  afford  to  hire  the  best 
and  the  brightest.  The  proper  place  for 
these  professionals  is  in  the  private  sector 
“where  they  can  contribute  to  the  process 
of  wealth  creation  necessary  to  maintain 
a  healthy  society.”  Others  argue  that  the 
present  acquisition  system  and  processes 
are  so  seriously  flawed  that  no  amount  of 
professionalism  in  the  workforce  can  bring 
about  improvement  (Library  of  Congress, 
1985,  p.  5).  From  this  perspective,  radical 
reform  of  the  overall  system  is  more  ur¬ 
gently  needed  than  workforce  reform. 

Apart  from  these  critiques,  there  re¬ 
mains  the  question  of  whether  we  can,  at 
some  future  time,  ever  know  whether  or 
not  DAWIA  has  produced  its  desired  con¬ 
sequence  of  an  improved  acquisition  sys¬ 
tem.  If,  for  example,  we  experience  fewer 
programs  with  cost  overruns,  can  we  say 
with  any  certainty  that  the  professional¬ 
ism  of  the  workforce  was  a  causal  factor? 
Suppose  on  the  other  hand  that  we  expe¬ 
rience  greater  numbers  of  programs  with 
overruns.  Can  we  say  that  DAWIA  led  to 
this  state  of  affairs?  Or  would  the  situa¬ 
tion  have  been  even  worse  without  the  leg¬ 
islation? 

The  uncertainties  and  ambiguities  sur¬ 
rounding  the  analysis  and  evaluation  of 
complex  policies  are  well  documented 
(e.g.,  Nakamura  and  Smallwood,  1980). 
Clearly,  we  have  no  models  or  techniques 
that  can  either  portray  all  relevant  acqui¬ 
sition  variables  or  predict  the  effects  of 
different  acquisition  policies  without  bias. 
We  are  therefore  left  with  fundamental  un¬ 
certainties  about  whether  or  not  DAWIA 
will  have  its  intended  consequences. 

Unintended  consequences,  however, 
are  another  matter  entirely.  We  have  sub¬ 


stantial  research  evidence,  again  from  the 
sociology  of  the  professions,  that  points 
to  some  troubling  potential  outcomes  of 
DAWIA.  Since  it  is  not  evident  that  these 
were  considered  in  the  debate  leading  to 
passage  of  DAWIA  (or  for  that  matter  in 
any  prior  attempts  to  reform  the  acquisi¬ 
tion  workforce),  their  explicit  consider¬ 
ation  is,  at  this  time,  appropriate. 

Process  Models:  Revealing  The 
Dark  Side  of  Professionalization 

Process  models  of  the  professions 
arose  as  a  response  to  critiques  of  at¬ 
tribute  models.  Some  sociologists  ar¬ 
gued  that  the  assumptions  of  attribute 
models,  particularly  the  assumption  that 
clients  are  better  served  as  workgroups 
become  more  professional,  lead  to  an 
emphasis  on  the  positive  side  of  profes¬ 
sions,  thereby  overlooking  implications 
of  power.  From  this  perspective,  the 
power  of  a  professional  group,  derived 
from  its  claims  of  expertise  and  special  sta¬ 
tus,  is  used  primarily  to  benefit  the  group’s 
membership  in  ways  frequently  at  odds  with 
the  public  interest  (Friedson,  1986). 

These  models  describe  the  steps  in  the 
process  of  professionalization,  defined  as 
“giving  a  professional  character  to,  treat¬ 
ing  as,  or  converting  into  a  profession” 
(Webster ’s  Third  New  International  Dic¬ 
tionary,  1961).  The  specific  steps  in  the 
process  and  the  order  in  which  they  occur 
vary  from  researcher  to  researcher,  but  in 
general  follow  the  same  basic  pattern 
(Wilensky,  1964): 

(1)  A  “critical  mass”  of  workers  is  in¬ 
volved  in  the  work  activity. 
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(2)  The  work  becomes  a  full-time  activ¬ 
ity. 

(3)  Training  schools  are  established  to 
transmit  the  skills  of  the  work. 

(4)  University  programs  are  established. 

(5)  Professional  associations  are  formed. 

(6)  Competition  occurs  with  neighbor¬ 
ing  occupations  over  the  boundaries 
of  the  work. 

(7)  A  code  of  ethics  is  developed. 

(8)  Political  action  (e.g.,  lobbying)  is 
taken  for  legal  protection  and  restric¬ 
tions. 

The  path  of  this  process  is  one  of  in¬ 
creasing  specialization  and  differentiation 
of  the  occupation.  The  occupation  gains 
status  by  portraying  itself  as  possessing 
unique  knowledge  and  skills;  indeed,  the 
more  unique  the  skills,  the  stronger  the 
claim  to  professional  status  (Foote,  1953). 
Occupations  are  motivated  to  emphasize 
their  uniqueness  and  are  under  tacit  pres¬ 
sure  to  develop  their  own  separate  bodies 
of  knowledge  (Larson,  1977,  p.  201).  Lev¬ 
els  of  understanding,  perspective,  and 
communication  across  occupational 
boundaries  decrease  as  the  level  of  isola¬ 
tion  increases  (Mosher,  1968,  pp.  122- 
123).  The  focus  of  the  occupation  turns 
increasingly  inward  toward  its  own  sur¬ 
vival  and  maintenance  at  the  expense  of 
service  to  the  public.  Claims  to  separate¬ 
ness  are  legitimated  and  a  facade  of  pub¬ 
lic  service  is  maintained  through  symbols 
such  as  university  programs,  certification 
procedures,  and  codes  of  ethics. 


The  work  group  becomes  more  con¬ 
cerned  with  taking  on  and  maintaining  the 
outward  manifestations  of  professionalism 
than  with  its  substance.  In  particular, 
completion  of  required  training  programs 
and  other  certification  requirements  be¬ 
come  ends  in  themselves  rather  than 
means  to  improved  quality  of  service,  and 
the  accompanying  certificate  becomes 
proof  of  professionalism.  Thus,  the  sales¬ 
man  of  burial  plots  is  no  longer  a  sales¬ 
man,  but  a  “professional  memorial  con¬ 
sultant”  with  a  diploma  issued  after  a  one- 
week  training  course  to  prove  it 
(Liberman,  1970,  p.  52). 

Process  models  lead  to  a  critical  inter¬ 
pretation  of  what  attribute  models  mean. 
The  creation  of  a  specialized  knowledge 
base,  claims  of  service  motivation,  com¬ 
mitment,  codes  of  ethics,  and  other  at¬ 
tributes  are  revealed  as  no  more  than 
myths  created  by  work  groups  in  compe¬ 
tition  for  the  rewards  and  privileges  to  be 
gained  by  the  recognition  as  “profes¬ 
sional”  (Pavalko,  1988). 

Liberman’s  (1970)  analysis  is  espe¬ 
cially  critical.  Pointing  to  the  medical  and 
legal  professions,  he  argues  that,  since 
professionalism  springs  from  the  exercise 
of  specialist  skills,  judgments  relating  to 
competence  or  proper  professional  con¬ 
duct  may  be  exercised  only  by  the  profes¬ 
sionals  themselves;  that  is,  only  profes¬ 
sionals  are  qualified  to  Judge  themselves. 
Decisions  regarding  the  profession  may 
be  rightly  made  only  by  the  profession¬ 
als,  and  the  maintenance  of  the  profession 
is  their  principal  function.  Lawyers,  for 
example,  are  the  legal  system.  Profession¬ 
als  exercise  a  tight  self-serving  control 
over  their  fields,  hence  the  title  of 
Liberman’s  book,  “Tyranny  of  the  Ex¬ 
perts.” 
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It  must  be  noted  that  this  literature  pro¬ 
vides  no  evidence  that  these  troubling 
outcomes  stem  from  any  conscious  ma¬ 
levolent  intentions  of  work  group  mem¬ 
bers.  Rather,  the  movement  toward  spe¬ 
cialization  and  insularity  occurs  in  a  sub¬ 
conscious  or  unconscious  way  that  is  con¬ 
sistent  with  Niebuhr’s  (1960)  description 
of  the  way  injustice  tends  to  arise  in  any 
large  organization.  During  profession¬ 
alization,  members  continue  to  believe 
that  they  are  “doing  the  right  thing;”  that 
is,  elevating  the  quality  of  both  their  work 
and  themselves  in  the  best  interests  of  the 
public.  Actions  such  as  political  lobbying 
for  legislation  favorable  to  the  profession, 
for  example,  would  be  justified  by  its 
members  as  in  the  public  interest. 

DAWIA  AND  Professionalization: 

Current  Trends 


How  does  this  research  relate  to 
DAWIA?  It’s  clear  that  defense  acquisi¬ 
tion  is  proceeding  along  the  path  of 
professionalization  as  described  by  the 
process  models.  (We  may  debate  the  pre¬ 
cise  point  in  the  process  at  which  acquisi¬ 
tion  stands  [some  might  argue  that  some 
acquisition  career  fields,  contracting  for 
example,  have  completed  all  the  steps.] 
But  to  what  purpose?)  These  models  tell 
us  that  DAWIA  is  a  point  on  that  path,  and 
well-intentioned  as  it  may  be,  the  legisla¬ 
tion  will  have  consequences:  a  price  of 
professionalism.  We  may  begin  to  gauge 
this  price  by  looking  at  the  implementa¬ 
tion  of  some  of  DAWIA’s  provisions, 
which  indicates  a  trend  of  continuing  spe¬ 
cialization  and  insularity  of  the  acquisi¬ 
tion  workforce,  with  a  concomitant  focus 
on  the  trappings  of  professionalism. 


Most  obvious  of  course  is  DAWIA’s 
institution  of  an  Acquisition  Corps  for  the 
various  components  of  DoD.  DAWIA’s 
provisions  for  selection  criteria  for  corps 
members  and  for  the  designation  of  criti¬ 
cal  acquisition  positions  that  may  be  filled 
only  by  members  meeting  special  educa¬ 
tion,  training,  and  experience  require¬ 
ments,  mean  that  this  Corps  will  be  a 
highly  specialized  group,  separate  and  dif¬ 
ferentiated  from  others  within  DoD. 

Second,  DAWIA’s  provision  for  a  uni¬ 
versity  (DAU)  to  conduct  educational  de¬ 
velopment,  training,  and  research  and 
analysis  for  acquisition  means  that  these 
functions  will  be  executed  in  an  increas¬ 
ingly  separate  environment.  While  the 
Defense  Systems  Management  College 
(DSMC)  has  historically  been  the  leading 
institution  in  acquisition  training  and  re¬ 
search  for  DoD,  each  of  the  services  has 
to  some  degree  maintained  its  own  acqui¬ 
sition  training  capabilities  (e.g.,  the  Army 
Logistics  Management  College).  Under 
DAWIA,  the  centralization  of  acquisition 
training  management  means  that  these  in¬ 
stitutions  now  to  a  significant  degree  op¬ 
erate  under  and  respond  to  DAU  and  are 
thereby  distanced  from  their  respective 
services. 

Third,  within  the  Acquisition  Corps, 
separate  and  distinct  career  fields  (e.g., 
program  management,  acquisition  logis¬ 
tics)  are  institutionalized  by  DAWIA. 
Each  career  field  has  been  determined  to 
have  its  own  set  of  competencies:  a  unique 
body  of  knowledge.  This  means  that  there 
will  be  movement  toward  specialization 
and  differentiation  within  the  acquisition 
workforce.  For  example,  each  career  field 
will  have  its  own  training  and  certifica¬ 
tion  requirements  and  its  own  professional 
society  (e.g.,  National  Contract  Manage- 
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ment  Association,  Society  of  Logistics 
Engineers).  Each  career  field  will  become 
increasingly  expert  and  specialized,  but 
also  increasingly  differentiated  and  iso¬ 
lated  from  other  career  fields.  (The  spe¬ 
cialization  of  the  program  management  ca¬ 
reer  field,  which  is  associating  with  the 
civilian-oriented  Project  Management  In¬ 
stitute  [U.S.  Department  of  Defense,  1994, 
pp.  2-3],  is  ironic,  given  the  DoD  program 
manager’s  traditional  role  and  responsi¬ 
bility  of  integrating  the  efforts  of  the  vari¬ 
ous  acquisition  functional  areas.) 

The  separation  of  the  career  fields  will 
be  exacerbated  by  the  current  arrangement 
in  which  most  DAU  consortium  schools 
offer  courses  in  only  a  few  career  fields. 
Budgetary  pressures,  “turf’  issues,  and 
steady-state  enrollments  will  keep  schools 
from  expanding  their  offerings  into  other 
career  fields.  The  tendency  will  be  for 
schools  to  “play  to  their  strengths”  when 
faced  with  these  pressures,  which  may 
lead  to  a  consortium  of  DAU  specialist 
schools,  each  specializing  in  only  one  or 
two  career  fields. 

As  discussed  earlier,  the  institution  of 
certification  requirements  leads  to  a  view 
of  certification  as  an  end  rather  than  a 
means.  The  same  budgetary  pressures  will 
force  DAU  student  enrollments  and  the 
duration  of  required  training  to  minimal 
levels.  Acquisition  workforce  members 
will  be  pressured  to  get  training  certifica¬ 
tion  (to  “punch  their  tickets”)  in  their  ca¬ 
reer  fields,  with  little  regard  for  the  con¬ 
tent  or  substance  of  the  training. 

Other  points  may  be  noted,  but  the  trend 
is  evident.  While  the  acquisition  work¬ 
force  may  indeed  be  growing  more  pro¬ 
fessional,  the  price  of  this  professional¬ 
ism  is  its  growing  insularity  from  the  rest 
of  DoD.  As  the  process  continues,  levels 


of  understanding  and  communication  be¬ 
tween  the  acquisition  workforce  and  other 
DoD  professionals  (the  warriors,  the  per¬ 
sonnel  specialists,  and  others)  will  de¬ 
crease.  More  troubling,  the  perspective  of 
each  acquisition  career  field  will  narrow 
as  it  becomes:  first,  increasingly  preoccu¬ 
pied  with  its  own  discipline;  second,  more 
firmly  convinced  that  it  has  all  the  right 
answers;  and  third,  less  able  or  willing  to 
see  and  hear  what  is  going  on  in  other  ca¬ 
reer  fields.  The  acquisition  logisticians,  for 
example,  may  be  superb  professional  lo¬ 
gisticians  who  are  completely  incapable 
of  communicating  outside  their  discipline. 
Granted,  such  a  workforce  may  be  more 
professional  according  to  our  definitions, 
but  is  it  really  improved? 

This  illustrates  the  essentially  problem¬ 
atic  nature  of  professionalization.  As  we 
respond  with  increasing  specialization  to 
what  we  see  as  the  increasingly  technical 
challenges  of  acquisition  management,  we 
create  new  problems  for  ourselves.  And 
still  we  do  not  know  if  we  are  curing  the 
nation’s  acquisition  ills. 

Keeping  the  Price  Low 


Given  that  there  is  a  price  to  be  paid 
for  professionalism,  our  objective  should 
be  to  keep  that  price  as  low  as  possible. 
What  can  we  do  to  keep  the  acquisition 
workforce  from  becoming  too  insular  and 
to  maintain  a  balance  between  specializa¬ 
tion  and  perspective  across  disciplines  and 
career  fields?  We  may  begin  by  looking 
for  examples  of  professional  education 
and  training  that  aim  to  broaden  perspec¬ 
tives  among  members  of  the  profession. 
Such  examples  can  impart  insights  and 
stimulate  debate  on  the  best  way  to  pro¬ 
ceed  from  where  we  are  now. 
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One  possible  exemplar  is  the  profes¬ 
sional  education  and  training  of  Army  of¬ 
ficers.  (Navy,  Marine  Corps,  and  Air  Force 
officers  have  similar  professional  educa¬ 
tion  and  training  programs.)  In  this  model, 
specialized  professional  training  occurs 
early,  essentially  at  the  entry  level.  Gen¬ 
eralized  training  takes  over  very  soon 
thereafter  and  continues  throughout  the  re¬ 
mainder  of  the  officer’s  career.  Specifi¬ 
cally,  between  commissioning  and  about 
the  fifth  year  of  service,  the  officer  re¬ 
ceives  several  months  of  specialized  train¬ 
ing  in  the  skills  and  equipment  peculiar  to 
his  or  her  basic  branch  at  an  Army  school 
that  specializes  in  that  branch  (e.g.,  infan¬ 
try  training  occurs  at  the  Infantry  School 
and  Center  at  Fort  Benning;  signal  train¬ 
ing  at  the  Signal  School  and  Center  at  Fort 
Gordon).  After  this  point,  institutional 
education  and  training  is  almost  exclu¬ 
sively  generalist.  It  focuses  on  combat 
command  and  staff  operations,  leadership, 
and  management  not  only  across  the 
Army’s  basic  branches,  but  across  service 
and  national  boundaries  as  well.  Officers 
of  all  branches  receive  this  integrative  and 
interdisciplinary  training  together  at  insti¬ 
tutions  chartered  to  conduct  this  type  of 
generalist  training  (e.g.,  the  Command  and 
General  Staff  College  [CGSC]  at  Fort 
Leavenworth). 

The  sheer  volume  of  this  type  of  train¬ 
ing  is  also  instractive.  Top  officers  spend 
about  a  year  in  mid-career  resident  train¬ 
ing  at  CGSC  and  later  spend  another  year 
in  residence  at  a  Senior  Service  College. 

Does  this  model  of  training  preclude  the 
presence  of  ticket  punching  careerists,  the 
“price  of  professionalism,”  among  Army 
officers?  No,  it  simply  keeps  this  price  low. 

We  may  envision  such  a  model  applied 
to  the  acquisition  workforce.  Entry-level 


members  might  receive  specialized  career 
field  training  at  specialist  acquisition 
schools  around  the  country.  Mid-level  and 
senior  members  from  all  career  fields,  on 
the  other  hand,  would  meet  together  in 
residence  at  one  or  two  selected  acquisi¬ 
tion  research  and  teaching  institutions,  and 
devote  extensive  study  to  a  broad  range 
of  issues  cutting  across  the  various  career 
fields.  (Such  long-term  residential  pro¬ 
grams  have  been  suggested  in  the  past 
[U.S.  Congress,  House,  1990ab,  p.  219; 
Stupak,  1993,  p.  22],  and  the  Senior  Ac¬ 
quisition  Course  at  the  Industrial  College 
of  the  Armed  Forces  appears  to  be  a  move 
in  this  direction.)  The  current  practice  of 
awarding  intermediate  and  senior  level 
training  certification  on  the  basis  of 
completion  of  one-  or  two-week  courses 
would  be  abandoned  in  favor  of  long-term 
resident  study  programs. 

Clearly,  there  would  be  many  chal¬ 
lenges  to  be  met  and  substantial  invest¬ 
ments  to  be  made  to  make  such  programs 
a  reality. 

Conclusion; 

Two  Visions  of  the  Future  Workforce 

In  conclusion,  I  offer  two  possible  vi¬ 
sions  of  the  state  of  the  acquisition 
workforce  in  25  years.  One  vision  is  of 
disconnected  groups  of  specialists,  each 
narrowly  focused  on  their  own  particular 
piece  of  the  acquisition  puzzle.  The  other 
vision  is  of  a  workforce  that  takes  the 
broad  view,  bringing  together  diverse 
skills  and  perspectives  to  determine  how 
best  to  fit  together  all  the  pieces  of  the 
puzzle.  The  dialogue  on  which  vision  we 
choose  to  make  reality  should  begin  now. 
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TUTORIAL 


ODD'S  5000  DOCUMENTS: 
EVOLUTION  AND  CHANGE 
IN  DEFENSE  ACQUISITION  POLia 


Joe  Ferrara 


The  article  begins  with  a  brief  discussion  of  the  origins  of  the  5000  documents. 
Then  the  author  analyzes  the  nine  different  versions  issued  between  1971  and 
1993,  highlighting  the  major  principles  and  themes  of  each  issuance,  the 
principal  catalyst  behind  each  revision,  and  the  significant  changes  evident 
from  one  version  to  the  next.  The  article  concludes  by  reviewing  likely  changes 
to  be  pursued  in  the  near  future  as  various  acquisition  reform  study  efforts 
near  completion  and  DoD  revises  5000  once  again.' 


By  any  measure  the  defense  acqui¬ 
sition  system  is  undeniably  com¬ 
plex.  Hundreds  of  thousands  of 
employees  work  in  DoD  acquisition  or¬ 
ganizations,  which  execute  millions  of 
contract  actions  every  year.  Until  very  re¬ 
cently,  the  total  DoD  acquisition  budget  ex¬ 
ceeded  $  1 00  billion  annually.  Major  defense 
acquisition  programs,  which  account  for  a 
large  share  of  this  total  budget  authority,  are 
technologically  advanced  products,  often 
designed  to  achieve  performance  levels 
never  before  realized.  The  resulting  high  lev¬ 
els  of  uncertainty  and  technical  risk  demand 
skilled  and  intelligent  management. 

Since  the  early  1970s  DoD  executives 
have  used  a  few  key  policy  documents  to 
govern  the  sprawling  defense  procurement 
empire.  DoD  Directive  5000. 1  and  its  ac¬ 


companying  DoD  Instruction  5000.2 
(hereafter  DoDD  5000.1  and  DoDI 
5000.2)  have  been  the  foundation  of  the 
defense  acquisition  process  for  over  20 
years.  Since  1971  DoD  has  issued  a  new 
version  of  DoDD  5000.1  and  DoDI  5000.2 
nine  different  times.  During  this  period, 
DoD  has  developed  and  produced  hun¬ 
dreds  of  major  acquisition  programs  un¬ 
der  the  broad  principles  articulated  in  these 
documents.  Literally  thousands  of  career 
employees  and  political  appointees  have 
played  a  role  in  these  various  revisions. 

Based  on  their  longevity  and  relatively 
frequent  revisions,  the  5000  documents 
offer  a  unique  window  on  the  evolution 
of  policy  in  a  major  government  depart¬ 
ment.  Reviewing  this  policy  evolution  is 
especially  relevant  today  as  the  Clinton 
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administration  continues  its  ambitious 
program  of  acquisition  reform.  Many  of 
the  emerging  reform  recommendations — 
from  military  specifications  and  standards 
to  pilot  programs — involve  some  sort  of 
proposed  change  to  DoDD  5000.1  and 
DoDI  5000.2.  A  good  example  is  the  re¬ 
cently  completed  Oversight  and  Review 
process  action  team,  whose  final  report 
deals  directly  with  many  of  the  processes 
and  procedures  set  forth  in  the  5000  docu¬ 
ments  (Process  Action  Team,  1994). 

Given  the  inextricable  connection  be¬ 
tween  the  5000  documents  and  the  way 
that  DoD  manages  its  acquisition  process, 
and  the  current  emphasis  on  acquisition 
reform,  it  would  be  useful  to  gain  some 
historical  perspective  on  the  development 
and  evolution  of  the  5000  documents. 
What  were  their  original  purpose?  Why 
and  how  have  they  been  changed  over  the 
years?  How  do  these  changes  illustrate 
larger  trends  in  defense  acquisition  man¬ 
agement?  What  are  the  prospects  for  fu¬ 
ture  policy  development?  These  questions 
are  the  main  focus  of  this  paper. 

After  a  brief  discussion  of  the  origins 
of  the  5000  documents,  this  article  ana¬ 
lyzes  the  nine  different  versions  issued  be¬ 
tween  1971  and  1993,  highlighting  the 
major  principles  and  themes  of  each  issu¬ 
ance,  the  principal  catalyst  behind  each  re¬ 
vision,  and  the  significant  changes  evident 
from  one  version  to  the  next.  It  concludes 


with  a  review  of  likely  changes  to  be  pur¬ 
sued  in  the  near  future  as  various  acquisi¬ 
tion  reform  study  efforts  near  completion 
and  DoD  revises  5000  once  again. 

The  Origihs  of  Poiia 


How  did  the  5000  documents  become 
the  principal  vehicle  for  managing  defense 
acquisition?  To  answer  that  question  it  is 
necessary  to  turn  our  attention  back  to 
President  Richard  Nixon’s  first  term,  when 
Melvin  Laird  was  Secretary  of  Defense 
and  a  politically  active  industrialist  named 
David  Packard  was  serving  as  Laird’s 
Deputy.  Energy  and  environmental  pro¬ 
grams  were  gaining  widespread  currency 
while  the  increasingly  unpopular  war  in 
Vietnam  and  the  rising  costs  of  defense 
acquisition  began  to  result  in  congres¬ 
sional  disenchantment  with  DoD  weapons 
programs.  (Acker,  1982) 

This  disenchantment  led  in  turn  to  de¬ 
termined  congressional  attempts  to  reduce 
defense  spending.  As  the  Vietnam  draw¬ 
down  began  and  defense  spending  de¬ 
clined,  Laird  and  Packard  recognized  that 
they  needed  a  mechanism  for  effectively 
managing  defense  acquisition  and  control¬ 
ling  cost  growth,  especially  in  an  environ¬ 
ment  of  fiscal  constraint. 

Establishing  a  formal  acquisition  man¬ 
agement  regime  was  the  solution  they 
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settled  on.  In  May  1969  Packard  formed 
the  Defense  Systems  Acquisition  Review 
Council  (DSARC)  to  serve  as  an  advisory 
body  to  the  Secretary  of  Defense  on  mat¬ 
ters  concerning  acquisition  of  major 
weapon  systems  (Packard,  1969).  The 
original  DSARC  was  chaired  by  the  Di¬ 
rector  of  Defense  Research  and  Engineer¬ 
ing  (DDR&E)  and  was  chartered  to  review 
major  acquisition  programs  at  major  mile¬ 
stones  in  the  acquisition  cycle.  In  addi¬ 
tion,  Packard  directed  DDR&E  to  conduct 
occasional  management  reviews  of  major 
programs. 

In  May  1970  Packard  issued  another 
policy  memorandum  on  defense  acquisi¬ 
tion  (Packard,  1970).  This  memo  articu¬ 
lated  many  of  the  broad  themes  that  would 
later  become  the  foundation  for  the  5000 
series,  including  decentralized  execution, 
streamlined  management  structures,  and 
use  of  appropriate  contract  mechanisms. 
According  to  Packard,  the  primary  objec¬ 
tive  of  DoD  oversight  was  to  “enable  the 
Services  to  improve  the  management  of 
their  programs.”  Packard  clearly  believed 
that  the  defense  acquisition  system  needed 
improving;  “It  is  imperative  that  they  [the 
Services]  do  the  job  better  than  it  has  been 
done  in  the  past.”  The  May  1970  policy 
memo  established  broad  guidance  in  five 
major  areas:  management,  conceptual  de¬ 
velopment,  full  scale  development,  pro¬ 
duction,  and  contracts.  Approximately  a 
year  later,  in  July  1971,  the  first  DoDD 
5000.1  was  formally  issued. 

The  Founding  Document: 

DoD  Directive  5000.1,  July  197P 

Measured  against  the  standards  of 
today’s  DoD  directives  and  instructions. 


the  first  DoD  Directive  5000.1  was  in 
many  ways  a  very  austere  document:  Only 
seven  pages  long,  it  described  the  acqui¬ 
sition-related  duties  of  only  three  DoD  of¬ 
ficials-^  and  included  references  to  only  a 
handful  of  other  policy  documents.  In 
many  ways,  the  entire  acquisition  reform 
agenda  since  5000. 1  ’s  original  publication 
in  1971  can  be  characterized  as  one  long 
effort  to  realize  the  simple  but  powerful 
vision  contained  in  Packard’s  founding 
document: 

Successful  development,  produc¬ 
tion,  and  deployment  of  major  de¬ 
fense  systems  are  primarily  depen¬ 
dent  upon  competent  people,  ratio¬ 
nal  priorities,  and  clearly  defined  re¬ 
sponsibilities.  Responsibility  and  au¬ 
thority  for  the  acquisition  of  major 
defense  systems  shall  be  decentral¬ 
ized  to  the  maximum  practicable 
extent  consistent  with  the  urgency 
and  importance  of  each  program. 

The  development  and  production  of  a 
major  defense  system  shall  be  managed 
by  a  single  individual  (program  manager) 
who  shall  have  a  charter  which  provides 
sufficient  authority  to  accomplish  recog¬ 
nized  program  objectives.  Layers  of  au¬ 
thority  between  the  program  manager 
and  his  Component  Head  shall  be  mini¬ 
mum.  . .  [the]  assignment  and  tenure  of 
program  managers  shall  be  a  matter  of 
concern  to  DoD  Component  Heads  and 
shall  reflect  career  incentives  designed 
to  attract,  retain,  and  reward  competent 
personnel. 

It  is  not  too  difficult  to  trace  the  intel¬ 
lectual  heritage  of  many  of  today’s  stat¬ 
utes,  policies,  and  institutions  such  as  the 
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Defense  Acquisition  Workforce  Improve¬ 
ment  Act,  the  streamlined  acquisition 
chain  of  command,  and  the  Defense  Ac¬ 
quisition  University,  to  these  five  sen¬ 
tences. 

The  first  DoDD  5000.1  applied  to  all 
acquisition  programs,  although  it  referred 
specifically  to  “major  programs,”  to  be 
designated  by  the  Secretary  of  Defense  on 
the  basis  of  “dollar  value,'*  national  ur¬ 
gency,  or  recommendations  by  DoD  Com¬ 
ponent  Heads  or  Office  of  the  Secretary 
of  Defense  (OSD)  officials.”  While  OSD 
and  the  Components  were  charged  with 
program  monitoring,  the  directive  was 
careful  to  “place  minimum  demands  for  for¬ 
mal  reporting  on  the  program  manager.”’ 

The  directive  described  three  signifi¬ 
cant  decision  points:  program  initiation, 
full-scale  development,  and  production/ 
deployment.  Each  one  of  these  decision 
points  required  the  approval  of  the  Secre¬ 
tary  of  Defense.  Program  initiation  oc¬ 
curred  at  some  point  in  time  after  “early 
conceptual  efforts”  when  the  Component 
Heads  in  question  determined  “that  a  ma¬ 
jor  defense  system  program  should  be  pur¬ 
sued.”  Entry  into  full-scale  development 
would  occur  when  the  Component  “is  suf¬ 
ficiently  confident  that  program  worth  and 
readiness  warrant  commitment  of  re¬ 
sources  to  full-scale  development.”  Simi¬ 
larly,  entry  into  production  would  be  ap¬ 
proved  by  the  Secretary  when  the  Com¬ 
ponent  could  demonstrate  that  “engineer¬ 
ing  is  complete.” 

The  final  section  of  the  1971  DoDD 
5000.1  was  entitled  “Program  Consider¬ 
ations.”  This  section  described  a  number 
of  important  requirements  pertaining  to 


progression  of  a  program  through  the  ac¬ 
quisition  process,  including:  (1)  wherever 
feasible,  operational  needs  shall  be  satis¬ 
fied  through  the  use  of  existing  military 
or  commercial  hardware,  (2)  practical 
tradeoffs  shall  be  made  between  system 
capability,  cost,  and  schedule,  (3)  logistic 
support  shall  be  considered  as  a  principal 
design  parameter,  (4)  schedules  shall  be 
structured  to  avoid  unnecessary  overlap¬ 
ping  or  concurrency,  (5)  test  and  evalua¬ 
tion  shall  commence  as  early  as  possible, 

(6)  contract  type  shall  be  consistent  with 
all  program  characteristics,  including  risk, 

(7)  source  selection  decisions  shall  take 
into  account  the  contractor’s  capability  to 
develop  a  necessary  defense  system  on  a 
timely  and  cost-effective  basis,  and  (8) 
documentation  shall  be  generated  in  the 
minimum  amount  to  satisfy  necessary  and 
specific  management  needs. 

The  first  DoDD  5000.1  included  one 
enclosure  entitled  “Related  Policy.”  This 
enclosure  delegated  responsibility  for 
preparation  of  related  policy  documents 
to  a  few  OSD  officials.  Development  of  a 
policy  document  on  the  defense  technol¬ 
ogy  base,  for  example,  was  delegated  to 
the  DDR&E.  Preparation  of  a  document 
on  cost  analysis  was  delegated  to  the  As¬ 
sistant  Secretary  for  Systems  Analysis 
(now  the  Director  of  Program  Analysis 
and  Evaluation).  Establishment  of  a  policy 
document  on  logistic  support  was  assigned 
to  the  ASD  for  Installations  and  Logistics 
(now  the  Deputy  Under  Secretary  of  De¬ 
fense  for  Logistics).  In  all,  the  enclosure 
described  14  separate  policy  subjects  to 
be  documented  in  official  policy  memo¬ 
randa. 
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The  DoD  5000  Series;  1971 -1995 

An  analysis  of  subsequent  issuances  of 
the  5000  series.  In  the  discussion  below, 
particular  attention  is  paid  to  major  prin¬ 
ciples  and  themes,  policy  complexity,  and 
policy  context.  The  questions  addressed 
include: 

•  What  have  been  the  major  principles 
and  themes  articulated  in  the  5000  se¬ 
ries?  In  other  words,  what  have  been 
the  “constants”  of  defense  acquisition 
policy? 

•  What  have  been  the  major  changes 
and  shifts  in  acquisition  policy?  What 
has  been  the  political-historical  con¬ 
text  surrounding  the  major  revisions? 

•  What  conclusions  can  be  drawn  from 
this  policy  history? 

At  the  end  of  the  paper  is  a  table  that 
summarizes  the  key  differences,  and  simi¬ 
larities,  among  the  various  5000  editions.® 

The  5000  Series:  Poliq  Stability 

The  constant  pressure  to  reform  and 
improve  DoD’s  acquisition  processes  not¬ 
withstanding,  it  is  interesting  to  note  that 
with  very  few  exceptions  there  has  not 
been  wide  variation  in  the  fundamental 
management  principles  underlying  the 
defense  acquisition  system.  The  founding 
5000.1  set  the  tone  and  all  subsequent 
documents  have  been  remarkably  consis¬ 
tent  in  continuing  to  articulate  a  few  key 
themes.  This  is  remarkable  because,  as 
even  the  most  casual  observer  of  the  DoD 
procurement  scene  is  aware,  the  last  two 


decades  have  witnessed  an  extraordinary 
and  persistent  agitation  for  reform  and  im¬ 
provement.  The  juxtaposition  of  “time¬ 
less”  management  principles  etched  in  the 
granite  of  the  5000. 1  and  the  nonstop  calls 
for  reform  raise  a  very  interesting  issue: 
While  DoD  seems  to  have  become  quite 
accomplished  at  preaching  the  values  of 
good  management,  the  Department  ap¬ 
pears  quite  dissatisfied  with  its  efforts  to 
practice  what  it  preaches. 

What  are  the  constant  principles  and 
themes?  A  review  of  all  the  5000  issuances 
since  1971  reveals  that  a  few  in  particular 
stand  out  in  each  version  of  the  directive: 

Centralized  Policy,  Decentralized  Ex¬ 
ecution.  Each  5000  series  revision  since 
1971  has  stressed  the  importance  of  cen¬ 
tralized  policy-making  and  decentralized 
program  execution.  The  two  examples 
below  illustrate  the  kind  of  language  used 
to  communicate  this  principle.  The  1971 
revision  states: 

Responsibility  and  authority  for  the 
acquisition  of  major  defense  systems 
shall  be  decentralized  to  the  maxi¬ 
mum  extent  practicable  consistent 
with  the  urgency  and  importance  of 
each  program. 

The  1977  version  states: 

Responsibility  for  the  management 
of  system  acquisition  programs  shall 
be  decentralized  to  the  DoD  Com¬ 
ponents  except  for  decisions  retained 
by  the  Secretary  of  Defense. 

The  logic  underpinning  this  principle 
is  simple  but  persuasive:  Policy  formula¬ 
tion  and  adoption  are  best  done  by  central 
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actors  because  they  have  a  broader  appre¬ 
ciation  of  the  entire  Department’s  inter¬ 
ests  than  do  local  actors,  such  as  program 
managers  or  contracting  officers.  On  the 
other  hand,  local  actors  are  best  positioned 
to  manage  the  day-to-day  affairs  of  de¬ 
fense  programs  and  projects:  making  cost- 
performance  tradeoffs,  negotiating  with 
suppliers,  and  managing  contract  perfor¬ 
mance.  Each  5000.1  issuance  from  1971 
to  1986  used  some  close  variant  of  the 
1977  language  above.  Later  versions  have 
expanded  this  concept  in  new  sections  on 
subjects  such  as  “tailoring”  and  “stream¬ 
lined  acquisition  organizations.” 

Fly  Before  Buy.  Another  consistent 
theme  has  been  “fly  before  buy,”  which 
generally  refers  to  activities,  such  as 
prototyping  and  operational  test  and  evalu¬ 
ation,  designed  to  enhance  understanding 
of  technical  challenges  and  mitigate  as¬ 
sociated  risks  before  a  commitment  to  pro¬ 
duction  is  made.  Consider  the  two  ex¬ 
amples  below,  the  first  from  the  original 
1971  document,  the  other  from  the  1987 
version: 

Technical  uncertainty  shall  be  con¬ 
tinually  assessed.  Models,  mock-ups, 
and  system  hardware  will  be  used  to 
the  greatest  possible  extent  to  in¬ 
crease  confidence  levels ....  Test  and 
evaluation  shall  commence  as  early 
as  possible.  A  determination  of  op¬ 
erational  suitability,  including  logis¬ 
tic  support  requirements,  will  be 
made  prior  to  large-scale  production 
commitments,  making  use  of  the 
most  realistic  test  environment  pos¬ 
sible  and  the  best  representation  of 
the  future  operational  system  avail¬ 
able.  (1971) 


Competitive  prototyping  of  critical 
components,  subsystems,  or  systems 
and  early  operational  test  and  evalu¬ 
ation  beginning  in  the  concept  dem¬ 
onstration  and  validation  phase  are 
encouraged  and  shall  be  emphasized. 
(1987) 

Streamlined  Organizations.  Each 
5000  reissuance  has  also  emphasized  the 
need  to  keep  the  number  of  management 
layers  to  a  minimum.  The  1987  version, 
for  example,  stated  that  DoD  Components 
“shall  establish  a  streamlined  management 
structure”  for  managing  acquisition  pro¬ 
grams,  and  that  “program  management  di¬ 
rection  shall  only  be  issued  by  and  flow 
through  this  streamlined  management 
structure.”  Similarly,  the  1991  issuance 
called  for  “short,  clear  lines  of  authority 
and  accountability.”  “No  more  than  two 
levels  of  review  shall  exist  between  Pro¬ 
gram  Managers  and  their  designated  mile¬ 
stone  decision  authority.”  The  1991  ver¬ 
sion  also  made  a  point  of  singling  out 
“boards,  councils,  committees,  and  staffs” 
as  existing  only  to  provide  “advice  to  those 
responsible  for  managing  programs.”  Such 
entities,  however,  will  have  “no  authority 
to  and  shall  not  issue  programmatic  direc¬ 
tion  or  impede  the  orderly  progression  of 
programs  through  the  acquisition  process.” 

Limited  Reporting  Requirements.  An 

austere  reporting  approach  has  been  em¬ 
phasized  repeatedly  in  the  various  5000 
reissuances.  The  1975  version,  for  ex¬ 
ample,  stated  that  “documentation  shall  be 
generated  in  the  minimum  amount  to  sat¬ 
isfy  necessary  and  specific  management 
needs.”  And  the  1996  drafts’  include  a 
policy  statement  that  “consistent  with 
statutory  requirements,  program  manag- 
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Table  1: 

Number  of  5000  Issuances  per  Administration 


Administration 

No.  of  issuances 

Nixon 

1  (1971) 

Ford 

2  (1975,  77) 

Carter 

1  (1980) 

Reagan 

4  (1982,  85,  86,  87) 

Bush 

1  (1991)8 

Clinton 

1  (Just  completed) 

ers  and  other  participants  in  the  defense 
acquisition  process  shall  be  required  to 
present  only  the  minimum  information 
necessary  for  decision  authorities  to  un¬ 
derstand  program  status  and  make  in¬ 
formed  decisions.” 

Program  Stability.  Program  stability 
has  also  been  a  hardy  perennial  in  the  an¬ 
nals  of  defense  acquisition  policy.  Nearly 
every  issuance  of  the  5000  documents  has 
made  much  of  the  importance  of  program 
stability.  A  good  example  comes  from  the 
1987  version  of  the  5000.1,  which  stated 
that: 

Reasonable  stability  in  acquisition 
programs  is  essential  to  satisfying 
identified  military  requirements  in 
the  most  effective,  efficient,  and 
timely  manner.  Accordingly,  pro¬ 
gram  funding  and  requirements 
changes  shall  be  minimized  and  shall 
not  be  introduced  without  assessing 
and  considering  the  impact  of  such 
changes  on  the  overall  acquisition 
strategy  and  the  established  program 
baseline. 


The  5000  Series:  Policy  Change 

While  there  has  been  a  remarkable  de¬ 
gree  of  underlying  stability  in  general  prin¬ 
ciples,  acquisition  policy  has  changed  over 
time.  As  shown  in  the  summary  table  at 
the  end  of  the  paper,  historically  there  have 
been  two  main  catalysts  for  5000  policy 
change.  The  first  is  a  change  in  presiden¬ 
tial  administration.  Every  administration 
has  issued  its  own  version,  and  sometimes 
more  than  one.  The  Reagan  administra¬ 
tion,  which  held  office  for  two  full  terms, 
issued  four  different  versions  of  the  5000 
documents,  three  of  them  in  the  three  years 
between  1985  and  1987.  Today,  the 
Clinton  administration  is  working  on  a 
new  version  (discussed  in  a  later  section). 

What  changes  have  been  made  in  ac¬ 
quisition  policy  since  the  first  version  of 
5000?  A  chart  of  the  “course  of  policy 
change  in  chronological  fashion”  follows. 

1975:  A  New  Instruction.  The  first 
reissuance  of  5000  was  published  in  1975 
by  Deputy  Secretary  William  Clements. 
Differences  in  content  between  the  1971 
version  and  the  1975  version  were  mini- 
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Table  2: 

DSARC  and  DAB  Membership 

DSARC  (C.  1977) 

DAB  (Today) 

Defense  Acq.  Exec.,  Chair 

USD(A&T),  Chair 

Dir.,  De.f  Res.  &  Eng. 

Prin.  Dep.  USD(A&T) 

ASD  (Install  &  Log.)^ 

Vice  Chair,  JCS,  Vice  Chair 

ASD  (Comp.) 

USD  (Comp.) 

Dir.,  Planning  &  Evaluation 

Dir.,  Prog.  Anal.  &  Eval. 

Dir.,  Telecom.  &  C^  Systems 

ASD  (Strat.  &  Res.) 

Comp.  Acq.  Execs. 

Selected  Advisors: 

Chairman,  JCS 

Overarching  IPT  Leader 

DDR&E  (Test  &  Evaluation) 

Selected  Advisors: 

Chairman,  Cost  Analy.  Impr.  Group 

ASD  (Econ.  Sec.) 

Component  Head 

DUSD  (Acq.  Ref.) 

DUSD  (Env.  Sec.) 

DUSD  (Log.) 

Dir.,  Def.  Proc. 

Dir.,  Acq.  Prog.  Integ. 

Asst.  Gen.  Counsel  (Acq.  &  Log.) 

Dir.,  Test,  Sys.  Eng.,  &  Eval. 

Chair,  Cost  Analy.  Improv.  Group 

mal.  The  big  change  in  1975  was  the  issu¬ 
ance  of  an  accompanying  instraction,  DoD 
Instruction  5000.2,  signed  by  Malcolm 
Currie,  then-Director  of  Defense  Research 
and  Engineering. 

The  new  instruction  was  narrowly  fo¬ 
cused,  intended  to  establish  “instruction 
guidelines  governing  the  use  of  the  Deci¬ 
sion  Coordinating  Paper  (DCP)  and  the 
Defense  Systems  Acquisition  Review 
Council  (DSARC).”  The  DCP  was  to  be 
summary  document  that  would  “support 
the  DSARC  review  and  the  Secretarial  de¬ 
cision-making  process  throughout  the  ac¬ 
quisition  phase  of  the  system  program.” 
Interestingly,  this  description  of  the  DCP 
bears  a  close  resemblance  to  the  System 
Acquisition  Management  Plan  (SAMP) 
now  being  instituted  by  the  Air  Force  as  a 


new  streamlined  means  of  presenting  pro¬ 
gram  information  to  top  decision  makers. 

The  new  instruction  only  briefly  re¬ 
ferred  to  the  DSARC.  The  membership  of 
the  DSARC  and  other  administrative  de¬ 
tails  were  contained  in  the  DSARC  Char¬ 
ter,  DoD  Directive  5000.26.  According  to 
DoDI  5000.2  the  DSARC  was  to  serve  “as 
an  advisory  body  to  the  Secretary  of  De¬ 
fense  on  major  defense  system  acquisition 
programs  and  related  policies.”  The 
DSARC  was  chaired  by  the  DDR&E 
(DSARC  and  DAB  memberships  are  com¬ 
pared  in  Table  2). 

1977:  A  New  Milestone.  Institutional¬ 
izing  policy  change  literally  at  the  last 
minute,  the  Ford  administration  issued  a 
new  set  of  5000  documents  on  Jan.  18, 
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1977,  just  two  days  before  Jimmy  Carter’s 
inauguration.  This  time,  Deputy  Secretary 
William  Clements  signed  5000.1  and 
5000.2,  both  of  which  were  issued  that 
year  as  directives.  The  reason  was  that  this 
version  of  5000.2  cancelled  the  separate 
DSARC  Charter  and  included  DSARC 
membership  and  responsibilities  in  the 
body  of  the  instruction.  The  new  docu¬ 
ments  were  the  product  of  several  years 
of  work.  Several  important  events  contrib¬ 
uted  to  the  formulation  of  the  1977  ver¬ 
sion,  including  the  recommendations  of 
the  Commission  on  Government  Procure¬ 
ment,  the  establishment  of  the  Office  of 
Federal  Procurement  Policy,  and  the  issu¬ 
ance  of  0MB  Circular  A- 109. 

The  major  change  evident  in  this  ver¬ 
sion  was  the  addition  of  a  new  milestone 
decision  point.  The  1971  and  1975  ver¬ 
sions  had  described  three  major  decision 
points:  program  initiation,  full-scale  de¬ 
velopment,  and  production  and  deploy¬ 
ment.  The  1977  issuance  described  a  new 
decision  point  and  corresponding  phase: 
demonstration  and  validation.  This  addi¬ 
tion  was  part  of  a  continuing  trend  to  con¬ 
centrate  management  effort  on  reducing 
technical  risk  early  in  a  program’s  life- 
cycle  before  initiation  of  full  scale  devel¬ 
opment.  Of  course,  the  late  1970s  were  a 
period  of  heightened  Cold  War  tensions 
between  the  U.S.  and  the  U.S.S.R.  United 
States  defense  acquisition  policy  during 
this  period  was  to  respond  to  the  Warsaw 
Pact’s  overwhelming  quantitative  ad¬ 
vantages  by  pursuing  ever  more  ad¬ 
vanced  technological  solutions  to  mis¬ 
sion  needs. 

The  5000  documents  described  the  new 
decision  as  follows: 


When  the  DoD  Component  com¬ 
pletes  the  competitive  exploration  of 
alternative  system  concepts  to  the 
point  where  the  selected  alternatives 
warrant  system  demonstration,  the 
DoD  Component  Head  shall  request 
approval  to  proceed  with  the  dem¬ 
onstration  and  validation  effort. 

The  DoD  Component  Head  may 
conclude  that  the  demonstration  and 
validation  phase  should  involve  sev¬ 
eral  alternatives,  be  limited  to  a 
single  system  concept,  or  involve  al¬ 
ternative  subsystems  only  and  not  be 
conducted  at  the  system  level.  [The 
Component  Head  could  also  con¬ 
clude  that]  there  should  be  no  dem¬ 
onstration  and  that  the  program 
should  proceed  directly  into  full- 
scale  engineering  development. 

Other  important  changes  made  in  the 
1977  version  included  explicit  direction 
to  the  Service  Secretaries  to  “charter  a 
System  Acquisition  Review  Council  simi¬ 
lar  in  composition,  responsibilities,  and 
operation  to  the  DSARC  to  review  major 
system  acquisition  programs  and  to  advise 
the  Service  Secretary.”  The  “SARC”  was 
to  be  chaired  by  the  Service  Secretary  or 
Under  Secretary.  Given  the  contemporary 
focus  on  interorganizational  teamwork,  it 
is  interesting  to  note  that  the  5000  pro¬ 
vided  that  “upon  request  of  the  SARC 
Chairman,  the  Defense  Acquisition  Ex¬ 
ecutive  shall  designate  a  senior  OSD  staff 
official  to  participate  in  the  SARC.” 

1980:  Focusing  on  Cycle  Time  and 
Adding  More  Detail.  The  Carter  admin¬ 
istration  version  of  the  5000  is  notable  for 
several  reasons.  First,  it  included  a  discus- 
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sion  of  several  important  concepts,  includ¬ 
ing  acquisition  time  and  the  interaction 
between  the  acquisition  process  and  bud¬ 
get  process.  According  to  the  1980  5000. 1, 
a  “primary  objective  of  management  shall 
be  to  minimize  the  time  it  takes  to  acquire 
materiel  and  facilities  to  satisfy  military 
needs.  Particular  emphasis  shall  be  placed 
on  minimizing  the  time  from  a  commit¬ 
ment  to  acquire  an  operable  and  support¬ 
able  system  to  deploying  it  with  the  oper¬ 
ating  force.”  To  reduce  cycle  time,  the 
5000  authorized  Components  to  explore 
various  alternatives,  including  experimen¬ 
tal  prototyping  of  critical  components, 
combining  phases,  or  even  omitting 
phases  altogether. 

Second,  the  1980  version  greatly  ex¬ 
panded  the  descriptive  nature  of  the 
5000.2  instruction.  For  example,  the  in- 
stmction  included  an  8-page  enclosure  that 
listed  “DoD  policy  issuances  related  to  the 
acquisition  of  major  systems.”  This  enclo¬ 
sure  was  quite  detailed,  listing  such  docu¬ 
ments  as  the  Defense  Acquisition  Regu¬ 
lation,  DoD  Directive  5000.23,  System  Ac¬ 
quisition  Management  Careers,  DoD  Di¬ 
rective  4105.62,  Selection  of  Contractual 
Sources  for  Major  Defense  Systems,  and 
DoD  Instruction  7000.1 1,  Contractor  Cost 
Data  Reporting.  The  1980  version  also 
included  detailed  descriptions  and  formats 
for  required  documentation,  such  as  the 
DCP. 

Third,  the  1980  version  added  a  new 
document  to  the  list  of  reports  required  at 
major  milestone  reviews.  The  new  docu¬ 
ment  was  the  Integrated  Program  Sum¬ 
mary  (IPS),  which  is  still  in  use  today  (cur¬ 
rent  changes  in  documentation  are  dis¬ 
cussed  in  the  last  section  of  the  paper). 
According  to  the  1980  5000.2,  the  purpose 
of  the  IPS  was  to  summarize  “the  imple¬ 


mentation  plan  of  the  DoD  Component  for 
the  life  cycle  of  the  system.  The  IPS  pro¬ 
vides  information  for  a  management  over¬ 
view  of  the  entire  program.” 

Finally,  the  1980  version  described  the 
new  position  of  “DS ARC  Executive  Sec¬ 
retary.”  According  to  5000.2,  the  “Defense 
Acquisition  Executive  shall  designate  a 
permanent  Executive  Secretary  who  shall 
administer  and  coordinate  the  DSARC 
process.”  In  addition,  the  DSARC  Execu¬ 
tive  Secretary  would  be  responsible  for 
maintaining  and  distributing  periodic  sta¬ 
tus  reports,  assembling  and  distributing 
necessary  documentation,  maintaining  a 
central  reference  file  of  program  docu¬ 
mentation,  and  controlling  attendance  at 
the  DSARC. 

1982:  Implementing  the  Carlucci  Ini¬ 
tiatives.  The  main  impetus  driving  the  is¬ 
suance  of  the  1982  revisions  was  the  es¬ 
tablishment  of  the  Defense  Acquisition 
Improvement  Program  (DAIP),  better 
known  as  the  “Carlucci  Initiatives,”  after 
then-Deputy  Secretary  Frank  Carlucci. 
The  DAIP,  which  had  been  launched  by 
Carlucci  shortly  after  the  Reagan  admin¬ 
istration  took  office  in  early  1981,  was  a 
comprehensive  reform  effort  aimed  at 
improving  numerous  aspects  of  the  de¬ 
fense  acquisition  process.  The  DAIP  con¬ 
sisted  of  32  management  initiatives,  rang¬ 
ing  from  multiyear  procurement  and  eco¬ 
nomic  production  rates  to  design-to-cost 
and  linking  acquisition  and  budgeting. 

The  1982  revisions  reflected  many  of 
the  DAIP’s  themes.  As  Carlucci  stated  in 
a  cover  memorandum,  “The  attached  Di¬ 
rective  has  been  revised  to  reflect  the  prin¬ 
ciples  and  policies  of  the  Acquisition  Im¬ 
provement  Program.”  Many  of  these  prin¬ 
ciples  were  particularly  evident  in  5000. 1 : 
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Improved  readiness  and  sus¬ 
tainability  are  primary  objectives  of 
the  acquisition  process....  Reason¬ 
able  stability  in  acquisition  programs 
is  necessary  to  carry  out  effective,  ef¬ 
ficient,  and  timely  acquisitions.  To 
achieve  stability,  DoD  Components 
shall  conduct  effective  long  range 
planning,  consider  evolutionary  al¬ 
ternatives,  estimate  and  budget  real¬ 
istically,  [and]  plan  to  achieve  eco¬ 
nomical  rates  of  production. 

The  1982  version  also  made  a  change 
in  milestone  documentation,  replacing  the 
Mission  Element  Need  Statement 
(MENS)  with  the  Justification  for  a  Ma¬ 
jor  Systems  New  Start  (JMSNS).  The  pri¬ 
mary  objective  of  this  change  was  to  more 
closely  link  the  mission  need  determina¬ 
tion  process  with  the  resource  allocation 
process.  As  5000.1  stated,  “The  mission 
need  determination  is  accomplished  in  the 
PPBS  process  based  on  a  Component’s 
JMSNS  which  is  submitted  with  the  Pro¬ 
gram  Objectives  Memorandum  (POM)  in 
which  funds  for  the  budget  year  of  the 
POM  are  requested.’’ 

1985-86:  Responding  to  the  “Horror 
Stories.”  Near  the  end  of  President 
Reagan’s  first  term,  procurement  “horror 
stories”  began  cropping  up  with  alarming 
regularity  in  the  major  media.  As  J.  Ronald 
Fox  has  written: 

In  the  mid-1980s,  an  atmosphere  of 
uncertainty,  frustration,  and  appre¬ 
hension  pervaded  the  Pentagon  and 
its  contracting  base,  for  each  new  day 
brought  with  it  additional  regulations 
and  concerns  that  more  errors  would 
be  uncovered  by  either  the  press  or 


congressional  auditors,  investigators, 
and  overseers.  By  1986,  the  logjam 
of  procurement  legislation  awaiting 
implementation  had  become  so  great 
that  the  Pentagon  and  defense  indus¬ 
try  officials  pleaded  with  Congress 
for  a  moratorium  on  further  reform 
legislation.  (Fox,  1988) 

The  most  significant  change  in  the  1985 
version  designed  to  respond  to  procure¬ 
ment  “horror  stories”  was  the  naming  of 
the  Deputy  Secretary  as  the  “Defense  Ac¬ 
quisition  Executive.”  Appointment  of  a 
single  acquisition  executive  was  a  signal 
to  Congress  that  the  Pentagon  was  taking 
acquisition  management  seriously  (al¬ 
though  clearly  the  Deputy  Secretary  was 
not  a  “full-time”  acquisition  executive, 
since  he  spent  a  good  deal  of  each  work¬ 
ing  day  on  other  matters  not  related  to 
acquisition). 

1987:  Implementing  the  Packard 
Commission.  In  1987,  Congress  and  the 
Pentagon  both  began  an  intensive  cam¬ 
paign  to  respond  to  the  major  recommen¬ 
dations  of  the  Packard  Commission.  Presi¬ 
dent  Reagan  had  chartered  this  blue  rib¬ 
bon  commission  in  1985  to  examine  ways 
to  improve  defense  management  in  gen¬ 
eral,  and  defense  acquisition  specifically. 
The  commission  made  several  important 
recommendations:  Among  other  things, 
the  commission  suggested  the  establish¬ 
ment  of  a  new  full-time  political  appoint¬ 
ment  in  OSD,  an  Under  Secretary  of  De¬ 
fense  for  Acquisition  (USD(A))  who 
would  have  wide-ranging  powers  to  su¬ 
pervise  acquisition  throughout  the  entire 
Department.  The  commission  also  recom¬ 
mended  the  institutionalization  of 
baselining  weapons  programs  to  ensure  a 
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corporate  commitment  to  key  cost,  sched¬ 
ule,  and  performance  objectives. 

Congress  responded  to  the  Packard  rec¬ 
ommendations  very  enthusiastically  and, 
in  short  order,  enacted  the  Defense  Acqui¬ 
sition  Improvement  Act  of  1986,  which 
created  the  new  USD(A)  position.  Presi¬ 
dent  Reagan  nominated  Richard  Godwin, 
an  executive  with  the  Bechtel  Corporation, 
to  take  the  new  job  of  acquisition  czar. 
Within  a  few  months  of  his  confirmation, 
Godwin  initiated  another  revision  of  the 
5000  series  documents,  a  revision  which 
proved  to  be  very  controversial  and  ulti¬ 
mately  played  a  starring  role  in  Godwin’s 
resignation  after  less  than  a  year  in  the 
job.‘“ 

The  1987  documents  contained  several 
major  changes  over  previous  versions. 
First,  they  codified  the  new  streamlined 
acquisition  chain  of  command.  This  chain 
of  command  had  been  another  major 
Packard  recommendation.  The  new  chain 
ran  from  the  Program  Manager  through  a 
Program  Executive  Officer  to  the  Acqui¬ 
sition  Executive  of  the  military  depart¬ 
ment.  For  selected  major  programs,  of 
course,  the  chain  went  one  link  further  to 
the  new  USD(A),  who  functioned  as  the 
Department’s  Acquisition  Executive.  Pre¬ 
viously  this  position  had  been  held  by  the 
Deputy  Secretary. 

Second,  the  1987  documents  estab¬ 
lished  a  new  system  of  committees  to  sup¬ 
port  the  operation  of  the  Defense  Acqui¬ 
sition  Board  (DAB)."  According  to  the 
1987  DoDI  5000.2,  the  committees  were 
to  “provide  assistance  in  program  review 
and  policy  formulation.”  The  committees 
included  three  which  focused  on  program¬ 
matic  matters:  strategic  systems,  conven¬ 
tional  systems,  and  CT  systems,  and  seven 
others  that  were  designed  to  focus  on 


broader  policy  issues.  Among  the  latter  set 
were  science  and  technology,  nuclear 
weapons,  and  international  programs.  The 
catalyst  for  the  creation  of  these  commit¬ 
tees  was  Richard  Godwin’s  frustration 
with  the  number  of  standing  boards  and 
councils  that  reported  to  him  as  USD(A). 
One  count  went  as  high  as  126  separate 
boards  and  councils  under  his  jurisdiction, 
many  of  them  not  directly  related  to  ac¬ 
quisition.  Godwin  saw  the  DAB  commit¬ 
tee  system  as  a  means  of  consolidating  his 
management  structure  and  streamlining 
his  span  of  control.  Ironically,  only  the 
three  programmatic  committees  exist  to¬ 
day  (now  reconstituted  as  Overarching  In¬ 
tegrated  Product  Teams);  the  policy-ori¬ 
ented  committees  never  took  root  in  the 
acquisition  bureaucracy. 

Third,  the  1987  documents  established 
two  new  milestones:  Milestone  IV  and 
Milestone  V.  Milestone  IV  was  designed 
to  be  a  review  one  to  two  years  after  ini¬ 
tial  deployment  to  assure  operational 
readiness  and  support  objectives  are  be¬ 
ing  achieved  and  maintained  during  the 
first  several  years  of  operation.  Milestone 
V  was  defined  as  a  review,  5  to  10  years 
after  initial  deployment,  of  a  system’s  cur¬ 
rent  state  of  operational  effectiveness  and 
suitability  to  determine  if  major  upgrades 
are  necessary.  Both  post-production  mile¬ 
stones  were  added  to  the  5000  in  response 
to  long-standing  criticisms  that  the  acqui¬ 
sition  system  paid  too  little  attention  to  the 
life-cycle  implications  of  new  systems. 
The  theory  was  that  the  institutionaliza¬ 
tion  of  formal  decision  reviews  in  the 
trans-  and  post-production  periods  would 
force  the  Department’s  acquisition  lead¬ 
ership  to  continue  to  focus  on  the  progress 
of  weapons  systems  after  a  successful 
Milestone  III,  and  to  evaluate  the  possi- 
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bilities  for  system  life  extension  improve¬ 
ments  in  lieu  of  costly  new  acquisition 
programs. 

1991  AND  1996: 

What  a  Difference  Five  Years  Make 

The  1991  and  1996  revisions  of  the 
5000  documents  are  easily  the  most  far- 
reaching  changes  enacted  since  the  5000 
was  originally  published  in  1971.  The 
1991  documents  represented  a  dramatic 
centralization  of  policy  control  and  pro¬ 
cedural  specificity.  And  the  1996  version 
represents  an  equally  dramatic  reversal  of 
these  elements!  The  following  section  ana¬ 
lyzes  these  two  issuances. 

1991:  Policy  Overhaul.  The  1991  re¬ 
vision  was  prompted  by  Secretary  of  De¬ 
fense  Dick  Cheney’s  1989  Defense  Man¬ 
agement  Report  (DMR)  and  resulted  in 
two  revised  issuances,  DoDD  5000.1, 
“Defense  Acquisition,’’  DoDI  5000.2, 
“Defense  Acquisition  Management  Poli¬ 
cies  and  Procedures,”  and  a  new  DoD 
5000.2-M  Manual,  “Defense  Acquisition 
Management  Documentation  and  Re¬ 
ports.”  The  DMR  criticized  the  acquisi¬ 
tion  management  system  as  being  undis¬ 
ciplined  and  overburdened  by  regulation 
and  made  many  specific  recommendations 
for  improvement.  The  1991  documents 
were  a  concerted  effort  to  respond  to  the 
DMR  critique. 

There  were  four  main  objectives  of  the 
1991  overhaul  (Sylvester,  1991).  The  first 
goal  was  to  create  a  uniform  system  of 
acquisition  policy  by  consolidating  OSD 
guidance  in  one  set  of  documents  and  en¬ 
forcing  a  “no-supplementation”  rule  that 
barred  the  Components  from  supplement¬ 


ing  the  5000  guidance  with  their  own 
policy  initiatives. 

The  second  objective  was  to  discipline 
the  acquisition  management  process  by 
articulating  very  clear  (and,  as  some  crit¬ 
ics  argued,  rigid)  guidelines  for  how  pro¬ 
grams  should  proceed  through  the  acqui¬ 
sition  life  cycle,  and  by  providing  specific 
requirements  for  program  documentation. 

Third,  the  1991  documents  were  an  at¬ 
tempt  to  streamline  the  acquisition  regu¬ 
latory  regime.  This  was  to  be  accom¬ 
plished  by  consolidating  and  cancelling 
numerous  DoD  directives,  instructions, 
and  policy  memoranda  that  had  previously 
been  issued  separately.  More  than  50  such 
documents  were  cancelled  and  their  sa¬ 
lient  content  combined  into  the  new  5000 
issuances.  Examples  include  an  August  5, 
1988,  Deputy  Secretary  policy  memoran¬ 
dum  on  “Computer-Aided  Acquisition  and 
Logistics  Support,”  DoD  Directive 
4120.18,  “The  DoD  Metrication  Pro¬ 
gram,”  and  DoD  Instruction  7220.31, 
“Unit  Cost  Reports.”  In  most  cases,  much 
of  the  substantive  content  of  these  docu¬ 
ments  was  retained. 

The  fourth  and  final  aim  of  the  1991 
rewrite  was  to  address  a  litany  of  com¬ 
mon  complaints.  Some  of  the  most  often 
voiced  complaints  were  that  the  decision 
process  was  cluttered  with  too  many 
people  and  offices  and  that  many  of  these 
officials  openly  operated  as  “advocates” 
capable  of  exercising  “veto”  power  over 
a  program’s  progress  if  their  unique  de¬ 
mands  weren’t  met. 

The  1991  version  reflected  several  ma¬ 
jor  changes.  First,  the  5000.2  was  now 
applied  to  all  acquisition  programs,  not 
just  major  programs.  This  was  a  signifi¬ 
cant  departure  from  previous  practice, 
under  which  the  procedures  spelled  out  in 
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the  5000.2  were  intended  for  specific  ap¬ 
plication  only  to  major  programs.  (Since 
the  first  Packard  edition,  the  5000.1,  on 
the  other  hand,  has  always  stated  general 
policies  intended  for  application  to  all  ac¬ 
quisition.) 

Second,  the  documents  created  a  new 
set  of  four  acquisition  categories,  or 
“ACATs,”  which  characterize  a  program’s 
risk,  complexity,  and  level  of  management 
authority.  ACAT I  programs  are  major  pro¬ 
grams,  as  defined  in  Title  10.'^  ACAT  II 
programs  are  smaller  programs  that  meet 
the  statutory  criterion  for  “major  sys¬ 
tems. ACAT  Ills  and  IVs  are  still 
smaller  programs,  whose  proper  level  of 
management  authority  is  determined  by 
the  Component. 

Third,  the  1991  documents  were  the 
most  comprehensive  in  5000  history  in 
terms  of  guidance  and  information  pro¬ 
vided  to  the  field.  The  three  documents — 
5000. 1, 5000.2,  and  the  manual — spanned 
over  900  pages  in  length.  No  other  ver¬ 
sion  of  the  5000  documents  since  1971 
ever  exceeded  60  pages.  In  part,  this  in¬ 
crease  in  volume  was  due  to  the  consoli¬ 
dation  of  numerous  directives  and  instruc¬ 
tions  that  formerly  had  been  issued  as 
separate  documents.  The  increase  was  also 
due  to  a  deliberate  attempt  to  provide  as 
much  specific  information  as  possible  on 
subjects  such  as  decision  criteria,  key 
phase  activities,  and  document  formats. 

In  sum,  the  underlying  shift  in  1991  was 
a  transition  from  a  personal  interaction 
among  OSD,  the  Components,  and  pro¬ 
gram  offices  to  a  more  formalized  report- 
based  interaction  in  which  all  necessary 
information  would  be  transmitted  in  writ¬ 
ing.  This  basic  shift  has  now  been  reversed 
by  the  new  1996  documents,  which  are 
discussed  next. 


1996:  Institutionalizing  Acquisition 
Reform.  Today,  the  Department  is  again 
revising  the  5000  series  documents.  At  this 
writing,  the  new  1996  version  has  just 
been  completed  and  is  being  forwarded 
to  the  Secretary  of  Defense  for  final  ap¬ 
proval.  The  1996  version  was  prepared  by 
a  joint  working  group,  which  consisted  of 
representatives  from  OSD,  the  military 
departments,  and  the  Defense  agencies, 
and  was  co-chaired  by  the  Deputy  Under 
Secretary  of  Defense  (Acquisition  Re¬ 
form)  and  the  Director,  Acquisition  Pro¬ 
gram  Integration. 

There  are  four  principal  objectives  un¬ 
derpinning  this  most  recent  rewrite.  First, 
this  revision  seeks  to  clearly  separate  man¬ 
datory  policies  and  procedures  from  dis¬ 
cretionary  practices.  The  intent  is  to  free 
managers  to  exercise  sound  judgment 
when  structuring  and  executing  defense 
acquisition  programs. 

Second,  the  new  version  incorporates 
into  the  5000  series  new  laws  and  regula¬ 
tions  that  have  been  enacted  since  the  last 
update.  These  include  the  Federal  Acqui¬ 
sition  Streamlining  Act  of  1994  and  nu¬ 
merous  policy  memoranda  issued  by  DoD 
acquisition  officials,  including  new  policy 
documents  issued  to  implement  acquisi¬ 
tion  reform  recommendations. 

Third,  the  latest  edition  consolidates, 
for  the  first  time  ever,  acquisition  policy 
guidance  for  weapon  systems  and  auto¬ 
mated  information  systems.  Historically, 
the  Department  has  treated  these  two 
classes  of  acquisition  programs  separately 
in  terms  of  policies  and  procedures.  Sev¬ 
eral  separate  AIS  policy  documents  in  the 
7920  and  8120  directive  and  instruction 
series  will  be  cancelled. 

Finally,  this  revision  is  intended  to  re¬ 
spond  to  a  growing  perception  that  the 
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current  5000  documents  are  unwieldy  and 
too  complex.  To  make  the  documents 
more  “user-friendly,”  the  final  documents 
will  be  incorporated  into  the  forthcoming 
Defense  Acquisition  Deskbook.  The 
Deskbook  will  be  the  universal  electronic 
and  hard-copy  repository  of  all  DoD  man¬ 
datory  direction  and  discretionary  guid¬ 
ance. 

The  new  1996  documents  institute  sev¬ 
eral  major  changes.  First,  while  the  new 
DoD  Directive  5000.1  specifies  guiding 
principles  for  all  acquisition  programs 
across  the  Department,  the  new  regulation 
(more  below  on  the  switch  to  a  “regula¬ 
tion”)  5000.2  only  applies  to  major  pro¬ 
grams.  This  reverses  the  scope  of  the  1991 
5000.2.  The  intent  of  this  change  is  to  de¬ 
centralize  acquisition  practice  as  much  as 
possible  and  allow  Component  Acquisi¬ 
tion  Executives  more  of  a  hand  in  manag¬ 
ing  the  programs  for  which  they  are  being 
held  accountable. 

Second,  the  1996  5000.1  articulates 
several  new  guiding  principles  that  reflect 
how  the  department’s  acquisition  system 
is  responding  to  the  larger  changes  in  the 
global  security  environment  wrought  by 
the  end  of  the  Cold  War.  For  example,  one 
of  the  new  policy  principles  stresses  the 
importance  of  “nontraditional  acquisi¬ 
tion”: 

The  Department  must  be  prepared  to 
plan  and  execute  a  diverse  variety  of 
missions.  To  meet  the  user’s  needs 
in  a  timely  manner,  the  acquisition 
system  must  be  able  to  rapidly  in¬ 
sert  advanced  technology  directly 
into  the  warfighter’s  arsenal.  Doing 
so  means  being  able  to  demonstrate 
new  and  improved  military  capabili¬ 
ties  on  a  scale  adequate  to  establish 


operational  utility  and  affordable 
cost.  Demonstrations  based  on  ma¬ 
ture  technologies  may  lead  to  more 
rapid  fielding.  Where  appropriate, 
managers  in  the  acquisition  commu¬ 
nity  shall  make  use  of  non-traditional 
acquisition  techniques,  such  as  Ad¬ 
vanced  Concept  Technology  Dem¬ 
onstrations  (ACTDs),  rapid  proto¬ 
typing,  evolutionary  and  incremen¬ 
tal  acquisition,  and  flexible  technol¬ 
ogy  insertion. 

Other  new  policy  principles  include 
modeling  and  simulation,  innovative  prac¬ 
tices,  and  Cost  As  an  Independent  Vari¬ 
able  (CAIV). 

Third,  the  1996  version  moves  away 
from  the  1991  document’s  report-based 
interaction  model.  The  1996  version  ex¬ 
plicitly  relies  on  Integrated  Product  Teams 
(IPTs)  to  break  down  the  barriers  between 
different  organizations  and  acquisition  dis¬ 
ciplines  and  encourage  integrated  solu¬ 
tions  to  management  problems.  Moreover, 
the  1996  version  cancels  numerous  report 
formats  previously  mandated  by  the  1991 
documents  (see  Table  3).  The  focus  in  the 
new  5000  is  on  assembling  the  proper  in¬ 
formation  for  decision  makers;  the  spe¬ 
cific  packaging  and  formats  of  this  infor¬ 
mation  is  treated  as  an  issue  of  secondary 
importance. 

Fourth,  at  this  writing,  OSD  leadership 
is  considering  a  new  method  for  updating 
the  5000  documents.  As  this  article  has 
shown,  the  traditional  approach  has  been 
to  engage  in  a  “full-court  press”  of 
Herculean  proportions  every  several  years 
to  update  policy  and  practice.  Now,  to 
make  the  policy  more  of  a  dynamic  repre¬ 
sentation  of  the  areas  currently  being  em¬ 
phasized  by  the  Department’s  leadership. 
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Table  3: 

Report  Formats  in  the  New  5000 


Specifically  Mandated 

Format  No  Longer  Cited 

Consolidated  Acquisition  Reporting  System 

Mission  Need  Statement 

Operational  Requirements  Document 

Integrated  Program  Summary 

Test  and  Evaiuation  Master  Plan 

(Includes  Acquisition  Strategy  Report) 

Live  Fire  Test  and  Evaluation 

System  Threat  Assessment  Report 

Major  AiS  Quarterly  Report 

Manpower  Estimate  Report 

Cost  and  Operational  Effectiveness  Analysis 

LRIP  Report  for  Ships/Satellites 

Vaiue  Engineering  Report 

Program  Deviation  Report 

MYP  Contract  Certification 

Fixed  Price  Contract  Certification 

one  proposal  under  consideration  is  to  use 
a  standing  board, chaired  by  OSD  and 
including  representatives  of  the  military 
departments,  to  vet  policy  proposals  and 
authorize  their  inclusion  in  the  5000  docu¬ 
ments.  The  chief  advantages  of  such  an 
approach  would  be  to  instill  more  disci¬ 
pline  into  the  policy-making  process  and 
to  avoid  such  long  lag  times  between  the 
initial  articulation  of  a  new  policy  and  its 
ultimate  institutionalization  in  the  5000 
series. 

COHCLUSiON 


The  5000  series  documents  are  a  unique 
window  that  allow  us  to  see  both  the  sta¬ 
bility  and  change  evident  in  defense  ac¬ 
quisition  policy  over  the  last  25  years. 
While  it  is  easy  to  criticize  the  fairly  fre¬ 
quent  changes  in  the  5000  documents  over 
the  years  as  evidence  of  a  Department  un¬ 
clear  about  how  it  wants  to  proceed,  there 


is  a  more  optimistic  (and,  I  would  argue, 
realistic)  view.  The  evolution  of  the  5000 
documents  reveals  a  Department  sensitive 
to  changes  in  its  environment  and  quite 
willing  to  adapt  its  internal  procedures  to 
respond  to  this  environmental  turbulence. 

In  the  early  1970s,  as  the  Vietnam  draw¬ 
down  began,  the  Department’s  leadership 
took  action  to  ensure  a  disciplined  ap¬ 
proach  for  managing  acquisition  in  the 
post-Vietnam  era.  In  the  mid-1980s,  the 
Department  moved  to  institute  several 
policy  changes  in  response  to  the  Packard 
Commission  and  the  acquisition  improve¬ 
ment  legislation  it  spawned.  And  finally, 
in  the  1990s,  the  Department  has  moved, 
first,  to  consolidate  an  acquisition  policy 
system  that  had  grown  out  of  control,  and 
second,  to  “deconstruct”  this  consolidated 
mass  into  a  minimal  set  of  mandatory  prin¬ 
ciples  and  procedures  that  provides  man¬ 
agers  the  greatest  possible  discretion.  In 
each  of  these  policy  eras,  the  5000  has 
been  the  primary  vehicle  for  change. 
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End  Notes 


1 .  The  author  would  like  to  acknowledge 
the  kind  assistance  of  several  col¬ 
leagues,  including  David  Anderson, 
Fred  Reinhard,  John  Smith,  and  Ric 
Sylvester. 

2.  The  reader  should  note  that  before  the 
5000  series,  DoD  had  relied  on  the 
3200  series  to  articulate  defense  R&D 
and  procurement  policies  and  proce¬ 
dures.  For  example,  Secretary  of  De¬ 
fense  Robert  McNamara  issued  DoD 
Directive  3200.9,  “Initiation  of  Engi¬ 
neering  and  Operational  Systems  De¬ 
velopment,”  in  July  1965. 

3.  The  Secretary,  Director  of  Defense 
Research  and  Engineering,  and  the 
Assistant  Secretary  for  Telecommu¬ 
nications.  It  is  interesting  to  note  that 
the  first  5000  distinguished  between  ac¬ 
quisition  programs  under  DDR&E’s 
cognizance  and  those  programs  under 
the  jurisdiction  of  the  ASD(Telecom- 
munications).  Twenty-six  years  later, 
the  names  have  changed  but  the  De¬ 
partment  is  still  wrestling  with  this  di¬ 
vision  of  labor. 

4.  Then  defined  as  “programs  which 
have  an  estimated  RDT&E  cost  in  ex¬ 
cess  of  50  million  dollars  or  an  esti¬ 
mated  production  cost  in  excess  of 
200  million  dollars.” 

5.  Limited  reporting,  of  course,  contin¬ 
ues  to  be  a  major  concern  today. 


6.  Please  note  that  this  table  is  a  sum¬ 
mary  and  is  not  intended  to  provide  a 
complete  description  of  each  docu¬ 
ment. 

7.  As  of  this  writing,  USD(A&T), 
DOT&E,  and  ASD(C3I)  have  ap¬ 
proved  the  1996  final  drafts  and  for¬ 
warded  them  to  the  Secretary  of  De¬ 
fense  for  final  approval. 

8.  An  update  was  published  in  February 
1993,  right  at  the  beginning  of  the 
Clinton  administration,  but  this  was 
really  only  an  administrative  change, 
not  a  formal  reissuance  of  the  direc¬ 
tive  and  instruction. 

9.  The  reader  should  note  that  the  old 
ASD(I&L)  organizations  had  broad 
responsibilities,  to  include  both  pro¬ 
duction  and  contracting  issues. 

10.  During  the  final  stages  of  the  1987 
5000  revision,  Mr.  Godwin  com¬ 
plained  that  higher  officials  had  re¬ 
vised  key  sections  of  the  documents 
to  dilute  his  statutory  authority.  A 
point  of  particular  contention  was  the 
replacement  of  the  word  “establish” 
with  the  word  “develop”  in  a  sentence 
stating  that  a  primary  role  of  the 
USD(A)  was  to  “establish”  acquisi¬ 
tion  policy  for  the  Department. 

11.  The  DAB  was  the  new  name  for  the 
DSARC,  which  had  been  temporarily 
renamed  the  Joint  Requirements  and 
Management  Board  during  1986. 
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12.  10  use  2430. 

13.  10  use  2302. 

14.  It  is  worth  noting  that  this  working 
group  method  is  a  departure  from  pre¬ 
vious  practice.  Many  (but  not  all)  pre¬ 
vious  5000  rewrites  were  developed 
by  small  teams  of  OSD  officials  and 
then  coordinated  with  the  rest  of  the 
Department. The  1996  version  was  de¬ 
veloped  jointly  by  a  working  group 
that  included  over  20  representatives 
of  the  Department’s  acquisition  orga¬ 
nizations. 


15.  One  candidate  for  this  standing  board 
is  the  Joint  Functional  Team  (JFT), 
which  was  established  in  1995  to 
oversee  the  operations  of  the  Defense 
Acquisition  Deskbook.  The  JFT  is  co¬ 
chaired  by  the  DUSD(AR)  and  the  D, 
API. 
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TUTORIAL 


TRANSATUNTiC  COOPERATIVE 
WEAPONS  DEVEIOPMENT: 

HOW  CAN  WE  BEnER  ENSURE  SUCCESS? 


Davi  M.  D'Agostino 

This  paper  evaluates  and  compares  two  multinational  weapons  development 
efforts:  a  cancelled  program  (Multiple  Launch  Rocket  System  Terminal 
Guidance  Warhead)  and  a  new  program  (Medium  Extended-Range  Air  Defense 
System).  The  research  identifies  multinational  political  and  management  issues 
that  exacerbated  technical  and  schedule  problems.  Risk  areas  include:  number 
of  countries  and  industries;  differing  and  excessive  requirements;  cost  share 
and  technical  work  share  decisions;  consortia  versus  prime  contractors;  and 
international  program  office  staffing  and  decision  making.  The  paper  makes 
concrete  recommendations  to  improve  potential  for  success  in  the  new 
program. 


For  decades,  the  United  States  and  its 
allies  have  spent  billions  of  dollars 
on  collaborative  weapons  develop¬ 
ment  projects  that  have  generally  eluded 
success.  This  is  a  puzzling  phenomenon: 
the  main  objectives  of  cooperative  weap¬ 
ons  funding  and  development  are  to  elimi¬ 
nate  costly,  competing,  duplicative  pro¬ 
grams,  and  to  pool  requirements,  funding, 
and  talent  to  develop  affordable, 
interoperable  systems.  These  programs 
also  have  a  fundamental  political  objec¬ 
tive  of  cementing  relationships — which 
tend  to  be  stressed  when  multinational  pro¬ 
grams  fail.  Many  observers  attribute  pro¬ 
gram  failures  to  the  lack  of  political  sup¬ 
port,  priority,  advocacy,  and  multiyear 


funding.  But  very  few  have  taken  a  cold, 
hard,  deep  look  at  problem  programs  to 
identify  key  causes  and  improve  the  next 
program. 

All  weapons  development  efforts  entail 
some  level  of  cost,  schedule,  and  techni¬ 
cal  risk — if  they  don’t,  they  don’t  repre¬ 
sent  enough  advancement  in  capability  or 
technology  to  be  worth  pursuing.  My  re¬ 
search  examined  the  canceled,  four-nation 
Multiple  Launch  Rocket  System  Termi¬ 
nal  Guidance  Warhead  (MLRS/TGW) 
program  to  identify  some  of  the  key  po¬ 
litical  and  administrative  issues  that  added 
to  its  cost,  schedule,  and  technical  problems. 

If  the  MLRS/TGW’s  schedule  had  not 
slipped  more  than  six  years,  it  could  very 
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well  be  continuing  today  as  a  good  ex¬ 
ample  of  cooperative  development.  After 
the  program  was  canceled,  flight  tests  suc¬ 
cessfully  demonstrated  the  MLRS/TGW 
met  its  objectives  as  a  robust  tank-killing 
sub-munition.  Had  the  MLRS/TGW  come 
closer  to  its  originally  scheduled  initial 
production  (April  1989),  it  certainly  could 
have  been  selected  as  the  U.S.  Army’s 
submunition  of  choice. 

Using  MLRS/TGW  as  a  baseline,  I  ex¬ 
amined  the  same  aspects  of  the  prospec¬ 
tive  four-nation  Medium  Extended- Range 
Air  Defense  System  (MEADS)  to  iden¬ 
tify  similarities  and  differences.  At  the 
time  of  this  writing,  a  MEADS  Memoran¬ 
dum  of  Understanding  had  not  been  signed 
and  was  not  available  for  analysis.  In  ad¬ 
dition,  the  infancy  of  the  MEADS  pro¬ 
gram  did  not  allow  full  comparison  with 
many  critical  aspects  of  the  MLRS/TGW 
program.  At  the  same  time,  however,  this 
represents  a  great  opportunity  for  MEADS 
to  benefit  from  the  MLRS/TGW  experi¬ 
ence. 

From  the  research,  a  mosaic  of  uniquely 
multinational  political  and  administrative/ 
management  issues  emerged  to  explain 
many  problems  that  contributed  heavily 
to  difficulties  in  the  MLRS/TGW  pro¬ 
gram.  At  least  in  theory,  these  problems 
could  be  avoided  or  mitigated  for  future 
programs,  including  the  MEADS.  An 
overall  theme  emerged:  for  success  in 
multinational  programs  that  have  been 
well-selected,  national  political  issues 
and  pride  need  to  be  subordinated  to 


what  is  best  for  the  program.  The  main 
goal — to  develop  and  produce  a  multina¬ 
tional  weapon  system  that  meets  opera¬ 
tional  requirements  on  time  and  at  a  rea¬ 
sonable  cost — must  always  be  the  driver. 
It  is  difficult  enough  to  overcome  techno¬ 
logical  and  other  program  challenges  with¬ 
out  the  unique  complexities  of  success¬ 
fully  managing  a  multinational  develop¬ 
ment  effort. 

Some  limitations  to  the  research  are 
noteworthy.  The  ingredients  for  success 
identified  were  not  based  on  an  examina¬ 
tion  of  a  successful  program.  Moreover, 
experience  in  one  program  may  not  always 
be  applicable  to  another  program,  as  each 
multinational  development  effort  is  unique 
in  many  ways.  Finally,  there  is  no  guaran¬ 
teed  prescription  for  success,  as  many 
more  variables  than  were  examined  here 
have  important  effects  on  a  weapon  de¬ 
velopment  effort. 

The  Environment  for 
Transatuntic  Cooperation 


Many  ongoing  and  new  codevelop¬ 
ment  programs  have  been  managed  in  an 
environment  fraught  with  tensions  among 
political  pressures  for  pan-European  ver¬ 
sus  transatlantic  cooperation,  and  each 
nation’s  sharpened  concerns  over  the  sur¬ 
vival  of  their  defense  industries.  In  the 
mid-1980s,  Europe  made  great  political 
strides  for  pan-European  cooperation  in 
weapons  development.  NATO’s  Confer- 
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ence  of  National  Armaments  Directors  es¬ 
tablished  the  Independent  European 
Programme  Group  to  press  for  European 
Community-style  defense  cooperation. 
Since  weapons  procurement  was  not  in  the 
European  Commission’s  purview,  the  In¬ 
dependent  European  Programme  Group 
served  as  the  forum  for  cross-border  weap¬ 
ons  collaboration  and  procurement  in  Eu¬ 
rope. 

At  the  same  time,  in  an  effort  to  gain 
potential  savings  and  interoperability  from 
codevelopment  efforts  and  rise  above  a 
United  States-only  approach  to  weapons 
development  and  production,  the  Con¬ 
gress  passed  the  Nunn-Quayle  amend¬ 
ment  to  the  Arms  Export  Control  Act 
(1985)  to  promote  transatlantic  coopera¬ 
tion.  The  “top  down”  approach — making 
money  available  for  cooperative  ven¬ 
tures — led  to  a  proliferation  of  low-prior¬ 
ity,  two-year  efforts  that  were  not  contin¬ 
ued.  A  number  of  other  larger  transatlan¬ 
tic  cooperative  programs,  such  as  the 
North  Atlantic  Treaty  Organization 
(NATO)  Frigate,  fell  apart  for  various  rea¬ 
sons,  including  the  inability  to  agree  on 
requirements. 

After  the  Berlin  Wall  fell  and  the  So¬ 
viet  Union  dissolved,  the  U.S.  and  Euro¬ 
pean  defense  industries  began  more  rap¬ 
idly  and  radically  transforming  through 
mergers,  acquisitions,  and  downsizing  to 
respond  to  the  new  realities.  On  both  sides 
of  the  Atlantic,  defense  spending  became 
more  constrained  while  weapons  program 
costs  increased.  Also,  concerns  about  los¬ 
ing  critical  national  defense  production 
capabilities  and  jobs  were  on  the  rise. 

In  the  first  half  of  the  1990s,  the  Inde¬ 
pendent  European  Programme  Group  was 
moved  from  NATO  auspices  to  the  West¬ 
ern  European  Union — a  European  defense 


organization  with  no  U.S.  participation. 
France  apparently  took  the  lead  in  press¬ 
ing  for  intra-European  cooperation,  some¬ 
times  in  competition  with  potential  trans¬ 
atlantic  ventures.  France  continues  to  see 
itself  as  the  defense  technological  and  in¬ 
dustrial  leader  in  Europe — in  direct  com¬ 
petition  with  the  United  States.  At  the 
same  time,  U.S.  Defense  Secretary  Perry 
called  for  a  “renaissance”  in  cooperative 
weapons  development  with  Europe.  The 
MEADS  is  the  showcase  project  of  Sec¬ 
retary  Perry’s  “renaissance.” 

The  MLRS/TGW:  A  Good  Cooperative 
Weapons  Program  That  Could  Have 
Gone  Beher 


What  Was  the  MLRS/TGW  and 
What  Happened?  The  MLRS/TGW  was 
actually  phase  three  of  the  multinational 
MLRS  program.  The  objective  was  to  de¬ 
velop  a  target-sensing  submunition  and 
warhead  for  attacking  armored  targets  at 
distances  up  to  30  kilometers  or  more.  It 
was  to  be  launched  from  the  MLRS  rocket 
or  from  an  Army  Tactical  Missile  System. 

In  many  ways,  the  program  attempted 
to  go  well  beyond  the  state-of-the-art.  For 
example,  it  was  to  use  a  millimeter  wave 
seeker.  The  United  States  had  only  once 
before  attempted  to  develop  a  weapon 
system  that  uses  a  millimeter  wave  seeker, 
largely  because  of  technical  risk  and  cost. 
In  fact,  one  person  interviewed  noted  that 
the  MLRS/TGW  program  would  have 
benefited  from  some  additional  up-front 
substantive  research  on  the  seeker  and 
certain  other  components,  possibly  during 
the  concept  definition  phase. 

Political  pressures  to  get  the  interna¬ 
tional  program  started  and  under  way 
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overruled  some  program  officials’  desires 
to  take  this  path  to  lower  technical  risk. 
Instead  of  performing  additional  research 
up  front,  the  partners  took  a  cautious  three- 
stage  development  approach:  a  two- stage 
validation  program  (component  demon¬ 
stration  and  system  demonstration)  fol¬ 
lowed  by  a  maturation  and  full-scale  de¬ 
velopment  stage.  Figure  1  highlights  key 
events  in  the  MLRS/TGW  program. 

The  concept  definition  phase  began  in 
September  1981,  with  competing  multi¬ 
national  contractor  teams,  each  with  dif¬ 
ferent  companies  from  the  United  States, 
France,  Germany,  and  the  United  King¬ 
dom.  The  four  governments  signed  a 
Memorandum  of  Understanding  in  late 
1983.  The  governments’  cost  sharing  was 
established  in  that  agreement:  The  United 
States  would  fund  40  percent,  and  each  of 
the  European  allies  would  fund  20  percent. 
In  November  1984,  the  U.S.  Army 
awarded  a  cost-plus-incentive-fee  compo¬ 
nent  demonstration  contract  to  the  team 
with  the  best  technical  concept  and  the 


lowest  bid — Martin  Marietta  (United 
States),  Thomson  CSF  (France),  Diehl 
GmbH  &  Co.  (Germany),  and  Thom  EMI 
Electronics  (United  Kingdom). 

In  Febmary  1989 — two  years  behind 
schedule — the  Defense  Department  ap¬ 
proved  the  system  demonstration  substage 
for  the  MLRS/TGW,  but  with  several  con¬ 
ditions  attached.  The  conditions  were  that 
the  U.S.  Army  had  to  (1)  do  a  cost  and 
operational  effectiveness  analysis  compar¬ 
ing  the  MLRS/TGW  to  alternatives  for  de¬ 
feating  the  armored  threat,  (2)  define  spe¬ 
cific  actions  to  improve  the  ability  to 
manufacrnre  the  submunition,  and  (3)  pre¬ 
pare  a  test  and  evaluation  master  plan  de¬ 
fining  specific  quantitative  test  goals  for 
entering  into  full-scale  development. 

Over  time,  the  program  slipped  and 
encountered  many  difficulties.  During 
1990,  the  MLRS/TGW  competed  with 
a  previously  classified  U.S.  program, 
the  Brilliant  Anti-armor  submunition 
(BAT),  and  other  systems  in  a  U.S. 
Army  “neckdown.”  In  March  1991,  the 
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Figure  1.  Key  Events  in  the  MLRS/TGW  Program 
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Army  selected  the  BAT.  The  Congress 
would  not  permit  continued  funding  of 
both  MLRS/TGW  and  BAT,  and  the 
United  States  withdrew  from  the  MLRS/ 
TGW  program. 

Four  Countries/Industries  May  Be 
Too  Unwieldy.  Experts  on  international 
programs  agree  that  the  complexity  and 
difficulty  of  managing  a  successful  inter¬ 
national  program  increases  by  a  high  co¬ 
efficient  with  each  additional  partner.  The 
increased  complexity  in  decision  making 
with  four  partners  of  differing  languages, 
political  and  acquisition  systems,  and  cul¬ 
tures  placed  stress  on  the  MLRS/TGW 
program  and  a  drag  on  the  schedule  by  all 
accounts.  Program  officials  interviewed 
unanimously  agreed  that  two  or  three  part¬ 
ners  in  the  MLRS/TGW  would  have  been 
easier  to  manage  and  less  costly.  They  also 
believed  fewer  partners  would  have  been 
more  efficient  for  the  program  in  terms  of 
technical  performance,  program  manage¬ 
ment  and  decision  making,  administrative 
issues,  and  gaining  agreement  on  the  threat 
(discussed  further  below). 

For  example,  the  more  partners,  the 
more  problems  a  program  will  likely  have 
in  tracking  and  managing  cost  shares  and 
work  shares — which  can  be  critical  to  en¬ 
suring  fairness  in  a  multinational  program. 
In  the  MLRS/TGW,  the  40-20-20-20  cost 
share  was  tracked  and  managed  in  accor¬ 
dance  with  the  Memorandum  of  Under¬ 
standing.  Under  the  agreement,  exchange 
rate  fluctuations  and  inflation  in  any  of  the 
countries  affected  the  cost  shares  and  work 
shares. 

The  program  was  also  set  up  to  adjust 
the  work  share  to  cost  share  on  the  basis 
of  cost,  largely  to  ensure  equity.  That  is, 
if  a  company  was  performing  a  develop¬ 


ment  task  and  began  to  substantially  ex¬ 
ceed  the  estimated  cost  of  the  work,  that 
task  or  some  other  work  it  was  perform¬ 
ing  on  the  program  would  be  moved  or 
subcontracted  to  another  company  on  the 
team  for  completion.  While  this  was  a  dif¬ 
ficult  process  to  implement,  some  former 
project  officials  noted  this  had  a  side  ben¬ 
efit  of  helping  identify  companies  having 
technical  and  cost  problems  and  making 
adjustments  to  solve  them. 

Get  Detailed  Requirements  Agreed  to 
Up  Front.  The  program  got  underway 
with  only  the  most  general  agreement  on 
the  need  for  a  tank-killing  submunition  for 
use  behind  forward  lines  of  troops  and  a 
broad  technical  approach  (e.g.,  millime¬ 
ter  wave  seeker).  One  source  observed 
that,  when  the  four  governments  could  not 
agree  on  the  threat  details,  they  ignored 
them  and  moved  forward  with  the  pro¬ 
gram.  Throughout  much  of  the  component 
demonstration  phase,  the  four  nations  con¬ 
tinued  to  debate  the  specific  characteris¬ 
tics  of  the  threat — the  Future  Soviet  Tank 
in  the  year  2000.  As  late  as  1992,  the  U.S. 
Army  operational  requirements  document 
for  the  MLRS/TGW  remained  in  draft 
form. 

Many  programs  during  that  period  were 
dealing  with  an  evolving  threat.  Two 
changes  in  the  requirements  negatively 
affected  the  program’s  already  high  tech¬ 
nical  risk  and  ambitious  schedule.  In  the 
first  case,  the  requirements  changed  due 
to  a  newly  projected  reactive  armor  threat. 
Early  on,  the  United  States  and  the  United 
Kingdom  believed  the  Future  Soviet  Tank 
would  require  the  MLRS/TGW  to  have  a 
more  robust  lethal  capability  than  did 
Germany  and  France.  This  caused  the  pro¬ 
gram  to  switch  to  a  more  lethal 


Acquisition  Review  Quarterly — Fall  1996 


submunition  with  a  dual  shape  charge,  and 
caused  cost,  schedule,  and  technical  prob¬ 
lems  in  the  program.  In  the  end,  though, 
the  U.S.  and  U.K.  estimate  of  the  tank 
changed  to  agree  with  that  of  France  and 
Germany.  The  program,  however,  was  al¬ 
ready  committed  to  the  more  lethal  design. 

While  changing  lethality  requirements 
added  time  to  the  development  schedule, 
another  change  affected  the  schedule  even 
more  severely.  About  halfway  through  the 
development  effort,  France  and  Germany 
raised  a  new  requirement  to  overcome  the 
effects  of  high  reflectivity  snow.  This  new 
requirement  forced  the  program  to  add  a 
backup  seeker  with  Doppler  beam  sharp¬ 
ening  to  the  development  effort.  This 
backup  seeker  also  caused  the  team  to 
design  and  develop  another  type  of  signal 
processor.  It  was  a  very  high  risk  effort 
technically,  and,  in  retrospect,  the 
interviewees  unanimously  viewed  it  as 
unnecessary.  One  source  had  researched 
the  historical  occurrence  of  high 
reflectivity  snow  to  find  it  only  occurs  in 
very  few  European  theater  locations  for 
5-6  days  a  year,  in  a  narrow  window  of 
morning  hours. 

Select  the  Right  Companies  to  Do  the 
Right  Jobs.  As  with  many  programs, 
much  of  the  schedule  slippage  was  caused 
by  technical  difficulties  encountered  by 
the  contractors.  The  contractor  teams  that 
competed  for  the  MLRS/TGW  differed 
greatly  in  skill  for  the  development 
tasks — particularly  the  European  compa¬ 
nies.  The  team  that  won  on  the  basis  of 
low  bid  included  Diehl  of  Germany,  an 
ammunition  and  cartridge  producer,  and 
Thom  EMI  of  the  United  Kingdom,  an 
electronics  firm.  In  retrospect,  the 
interviewees  agreed  and  the  record 


showed  that  the  best  (most  technically 
qualified  and  experienced  for  develop¬ 
ment  tasks)  German  and  British  compa¬ 
nies  for  the  job  were  on  the  losing  teams. 
While  companies  from  all  four  countries 
encountered  technical  difficulties,  Diehl 
and  Thom  were  the  focus  of  most  com¬ 
ments  from  the  interviewees  regarding 
causes  for  schedule  slippage. 

Nevertheless,  the  governments  decided 
to  use  the  same  team  that  put  together  the 
winning  bid  and  national  political  pride 
was  put  at  stake.  Having  a  team  with  some 
weaker  members,  alone,  however,  did  not 
guarantee  major  problems.  The  potential 
risk  was  compounded  when  the  compa¬ 
nies  began  dividing  work  share  on  the 
program.  Work  share  was  not  distributed 
on  the  basis  of  the  companies’  technologi¬ 
cal  strengths  and  comparative  advantage. 
Instead,  development  tasks  were  distrib¬ 
uted  on  the  basis  of  the  work  the  compa¬ 
nies  (and  their  governments)  wanted  to  do 
in  the  program.  Moreover,  they  tried  to 
get  equality  in  the  work  shares — roughly 
25  percent  per  company  and  country — in 
terms  of  quality.  The  quality  factors  for 
work  shares  were  the  technologies’  posi¬ 
tion  related  to  the  state-of-the-art,  poten¬ 
tial  importance  to  competitiveness, 
uniqueness,  potential  applications  beyond 
the  MLRS/TGW,  and  potential  profitabil¬ 
ity. 

The  countries  and  companies  fought 
over  the  most  technologically  attractive 
work  shares — particularly  the  electronics. 
Their  objectives  were  not  what  work  share 
to  take  for  the  betterment  of  the  program, 
but  rather  what  work  share  would  most 
advance  their  companies’  competitiveness 
and  capabilities.  The  Europeans  won  most 
of  the  critical  electronics  work.  As  a  re¬ 
sult,  Diehl  worked  on  electronics  (e.g.. 
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flight  computer  and  leading  edge  inte¬ 
grated  circuits)  and  operational  flight  soft¬ 
ware  development  tasks  it  was  unable  to 
perform.  During  the  program,  Diehl  es¬ 
sentially  built  these  capabilities  in  its  com¬ 
pany  from  the  ground  up  and  at  the 
program’s  expense.  Most  interviewees 
cited  Diehl’s  poor  performance  on  its 
flight  computer  and  software  development 
tasks  as  causing  serious  schedule  slippage 
in  the  program.  In  retrospect,  the  U.S.  and 
French  were  considered  the  best  (most 
capable,  causing  fewest  difficulties  and 
delays)  for  the  software  development 
tasks — and  the  U.S.  likely  would  have 
done  the  work  at  lower  cost. 

Another  unfortunate  decision  made  in 
the  project  was  to  allow  the  development 
work  on  critical  components  to  be  split 
among  the  companies.  For  example,  the 
seeker  development  work  was  split  up  and 
spread  among  the  four  companies.  This 
made  integration  and  interface  an  even 
more  complex  task  than  it  might  have 
been.  In  addition,  search  and  target  detec¬ 
tion  software  development  tasks  on  the 
seeker  were  split  between  two  companies 
(the  United  States  and  Germany),  while 
the  target  tracking  software  development 
work  went  to  a  third  (the  United  Kingdom). 

Ohe  Production  Line  or  Two? 


The  decision  on  a  single  final  assem¬ 
bly  and  integration  line  was  also  afflicted 
by  nationalistic  politics.  Initially,  the  part¬ 
ners  agreed  that  all  requirements  would 
be  served  from  one  integration  line  in  the 
United  States,  with  the  components  com¬ 
ing  from  the  other  three  countries’  facili¬ 
ties.  This  made  sense  since  the  U.S. 
company’s  strength  was  in  integration.  In 


1990,  however,  the  European  partners  in¬ 
sisted  on  a  second,  European  integration 
line,  despite  the  likely  quantity  reduction 
in  all  the  partners’  requirements.  One 
source  noted  that  the  Europeans  pressed 
for  a  second  production  line  because  they 
wanted  to  freely  make  third  country  sales. 
However,  the  Memorandum  of  Under¬ 
standing  provided  that  sales  or  transfers 
outside  NATO  of  articles  developed  in  the 
project  with  the  use  of  foreground  data 
would  require  the  unanimous  prior  ap¬ 
proval  of  all  participants.  As  a  result,  any 
sale  of  MLRS/TGW  submunitions  would 
require  agreement  of  all  the  parties  in  any 
case.  Another  source  noted  that  both  the 
United  States  and  the  Europeans  decided 
they  wanted  full  production  capability. 
Had  the  program  reached  the  production 
phase,  two  lines  would  have  essentially 
obviated  any  unit  cost  savings  during  the 
production  phase — and  would  have  added 
to  all  the  partners’  production  costs. 

Have  a  Prime  Contractor — 

Consortia  Are  Not  Optimal 


Rather  than  assign  one  company  the 
prime  contractor  role,  the  four  companies 
formed  a  joint  venture  consortium — 
MDTT,  Inc. — to  sign  the  contract  and  pro¬ 
vide  overall  management.  The  govern¬ 
ments  supported  this  approach  mainly  for 
financial  reasons.  A  consortium  would 
avoid  the  high  overhead  costs  of  a  prime 
contractor  being  added  to  work  being  per¬ 
formed  by  the  others. 

While  this  was  a  good  goal  and  ap¬ 
proach  from  one  cost  control  perspective, 
all  interviewees  agreed  that  the  lack  of  a 
prime  contractor  on  the  program  contrib¬ 
uted  to  delays  and  technical  issues.  This 
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was  especially  true  given  the  cost-plus- 
incentive  fee  contract,  which  minimized 
government  involvement,  direction,  and 
oversight.  First,  there  was  little  account¬ 
ability  in  the  consortium,  and  decision 
making  on  work  share  was  hampered  by 
the  lack  of  leadership  in  MDTT.  In  addi¬ 
tion,  there  was  no  project  management, 
planning,  or  risk  analysis  from  the  com¬ 
panies.  The  sources  agreed  that  a  prime 
contractor  could  have  and  would  have  se¬ 
lected  the  best  companies  for  the  devel¬ 
opment  tasks,  determined  work  share 
more  on  the  basis  of  technological 
strengths  of  the  companies,  and  better 
managed  the  contractor  efforts. 

Administratively,  MDTT  also  encoun¬ 
tered  difficulties  getting  staffed  out  of  the 
European  companies,  as  did  the  European 
government  complement  in  the  interna¬ 
tional  program  office  (discussed  below). 
More  than  nine  months  after  the  compo¬ 
nent  demonstration  contract  had  been 
signed,  MDTT  still  did  not  have  a  full  con¬ 
tractor  team  in  place. 

Create  a  Fully-Staffed,  Full-Fledged 
International  Project  Office 


The  MLRS/TGW  had  an  international 
project  office,  but  the  French,  German, 
and  British  liaison  officers  did  not  repre¬ 
sent  a  full  complement  of  “program  of¬ 
fice-level”  decision  makers  from  their 
countries  and  were  not  vested  with 
deciison  making  authority.  The  European 
national  program  office  personnel  from 
these  three  countries  made  periodic  visits 
to  the  project  office,  located  at  the  U.S. 
Army  Missile  Command,  for  Technical 
Working  Group  meetings  and  other 
events.  Another  problem  in  project  office 


staffing  was  the  serious  delay  in  getting 
even  a  limited  European  government 
complement  in  the  international  project 
office.  In  the  case  of  one  country,  it  took 
nine  months  of  negotiation  to  get  a  liai¬ 
son  officer  assigned  and  located  in  the 
office. 

Some  interviewees  believed  a  greater 
team  culture  would  have  been  established 
if  all  the  principals  had  been  located  full¬ 
time  in  the  international  project  office. 
They  believed  this  would  have  resolved 
many  of  the  language  barriers,  nationalis¬ 
tic  pride  issues,  and  decision  making  im¬ 
pediments  the  program  encountered.  A 
source  also  noted  many  problems  could 
have  been  resolved  informally  in  a  full- 
fledged  international  project  office  setting 
(e.g.,  over  lunch).  Instead,  the  visits  cre¬ 
ated  a  more  formal,  less  congenial  atmo¬ 
sphere  for  timely  problem  solving.  “You 
need  to  live  together  so  that  your  honor  is 
not  placed  on  the  line  when  you  disagree.” 

Another  problem  that  might  have  been 
overcome  early  on  had  there  been  more 
of  a  true  team  culture  was  the  limited  shar¬ 
ing  of  “national  assets”  in  this  program. 
For  example,  one  interviewee  noted  that 
the  countries  had  some  background  data 
on  technologies  that  were  critical  to 
MLRS/TGW  success.  The  impression  was 
that  this  data  was  not  brought  to  the  table 
and  shared  openly  and  honestly.  Had  this 
data  been  shared,  and  had  the  countries 
formed  a  more  “seamless”  team,  many 
technical  problems  would  have  been  more 
easily  overcome.  Again,  in  this  vein,  the 
interviewees  emphasized  the  need  to  keep 
national  and  international  politics  out  of 
the  program  decision  making  to  the  maxi¬ 
mum  extent  possible,  and  focus  energy 
and  interests  on  doing  what  is  best  for  the 
program’s  progress. 
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Partnership  and  Consensus  Decision 
Making  Are  Good  and  Bad 


While  consensus  decision  making  can 
be  indicative  of  tme  partnership  and  eq¬ 
uitableness  for  all  players,  it  can  also  lead 
to  problems  and  a  more  negative  and  time- 
consuming  approach  to  reaching  agree¬ 
ment.  The  MLRS/TGW  program  em¬ 
ployed  a  consensus  decision  making  pro¬ 
cess,  with  three  levels  of  decision  author¬ 
ity  vested  in  multinational  committees. 
The  top  level  of  decision  making  was  the 
multinational  Joint  Steering  Committee 
(flag  officer  level)  which  met  semi-annu¬ 
ally.  The  next  level  was  the  Executive 
Management  Committee  (program  man¬ 
ager  level)  which  performed  cost,  sched¬ 
ule,  and  performance  oversight  and  met 
semi-annually.  The  next  level — the  first 
level  of  decision  making — comprised  the 
technical,  cost,  and  test  working  groups, 
which  included  lab  and  program  techni¬ 
cal  staffs  who  met  quarterly.  Disputes  that 
could  not  be  resolved  at  the  lowest  levels 
were  escalated  up  the  chain  described 
above.  The  U.S.-based  MLRS/TGW  pro¬ 
gram  office  was  the  “residence”  for  liai¬ 
sons  from  each  country. 

Several  sources  noted  that  getting  an 
answer  to  a  single  question  sometimes 
took  months.  In  addition,  U.S.  government 
personnel  and  contractors  found  that  prob¬ 
lems  they  normally  solved  in  one  meet¬ 
ing  took  three  meetings.  They  also  indi¬ 
cated  that  holidays  and  vacations,  heavier 
for  some  partners  than  others,  delayed 
progress  in  decision  making.  No  program 
activity  could  be  scheduled  during  the 
month  of  August,  for  example.  Some 
sources  noted  that  the  European  partners 
often  united  and  “out-voted”  the  United 


States. 

One  interviewee  characterized  the  de¬ 
cision  making  in  the  MLRS/TGW  as 
“nominally  consensus,”  but,  in  practice, 
it  was  a  process  based  on  threat  of  veto 
much  of  the  time.  When  the  parties  could 
not  reach  full  agreement  on  an  issue,  it 
was  a  matter  of  “who  screamed  and 
pounded  the  table  loudest.”  If  a  party  felt 
very  strongly  about  an  issue,  they  might 
threaten  to  veto  a  decision,  which  would 
stop  the  program.  This  sometimes  resulted 
in  a  more  negative  approach  to  decision 
making  rather  than  positive  agreement  and 
compromise. 

The  meads  Program: 

What  Path  Is  It  Taking? 


What  is  MEADS?  And  How  Did  it 
Become  a  Multinational  Program?  The 

U.S.  concept  of  the  MEADS  program  is 
that  it  is  a  multilateral  extension  of  the 
joint  U.S.  Army-Marine  Corps  “Corps 
Surface-to- Air  Missile”  (CorpsSAM)  be¬ 
gun  in  1990.  The  MEADS  is  to  provide  a 
follow-on  to  the  HAWK  air  defense  sys¬ 
tem,  initially  developed  in  the  1950s  and 
1960s.  It  is  also  expected  to  replace  the 
PATRIOT  (Pac  3)  system.  It  has  been  in¬ 
corporated  as  a  lower  tier  system  into  the 
Ballistic  Missile  Defense  Organization 
(BMDO)  approach  to  ballistic  missile  de¬ 
fenses.  U.S.  concepts  state  the  system  will 
be  designed  as  an  air-mobile  system  pro¬ 
viding  limited  area  and  point  defense  to 
maneuver  forces  and  critical  support  nodes 
against  tactical  ballistic  missiles  and  air- 
breathing  threats,  including  cruise  missiles 
and  unmanned  aerial  vehicles. 

Technical  and  political  issues  appear  to 
have  driven  the  four  countries  to  join  in 
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the  MEADS  program.  While  the  U.S.  con¬ 
cept  definition  for  the  CorpsSAM  pro¬ 
ceeded,  Germany  developed  a  concept  for 
a  HAWK  follow-on.  Germany  completed 
its  concept  definition  for  its  Taktisches 
Liiftverteidigiingssystem — TLVS  or  tacti¬ 
cal  air  defense  system — in  1991 .  In  1993, 
having  defined  the  U.S.  CorpsSAM  con¬ 
cept,  the  U.S.  Army  Missile  Command 
compared  and  evaluated  the  German  and 
U.S.  concepts,  finding  them  nearly  iden¬ 
tical.  This  prompted  early  discussions  of 
a  joint  United  States-German  effort  along 
CorpsSAM  lines.  At  the  same  time,  France 
and  Italy,  uninterested  in  ballistic  missile 
defense  capability,  were  courting  Ger¬ 
many  for  funding  and  participation  in  an 
upgraded  SAMP-T,  a  Franco-Italian  de¬ 
veloped  and  produced  air  defense  system. 

In  February  1994,  the  Deputy  Secretary 
of  Defense  invited  Germany  to  participate 
in  the  CorpsSAM  program.  By  the  spring 
and  summer  of  that  year,  France  objected 
to  Germany’s  tilt  toward  transatlantic  ver¬ 
sus  pan-European  cooperation,  and  dis¬ 
cussion  between  the  United  States  and 
Germany  ceased.  In  August  1994,  U.S., 
German,  and  French  principals  decided  to 
join  forces  on  the  MEADS.  Concerned 
about  having  no  role  in  such  a  major  pro¬ 
gram  that  would  compete  with  a  SAMP- 
T  upgrade,  Italy  joined  in  December  1994. 
In  February  1995,  the  four  countries 
signed  a  Statement  of  Intent  to  proceed 
with  MEADS.  The  four  nations  negotiated 
a  MEADS  program  Memorandum  of  Un¬ 
derstanding  for  the  first  phase  and  ex¬ 
pected  to  sign  the  agreement  in  early  1996. 
The  United  States  is  expected  to  fund  50 
percent,  France  and  Germany  20  percent 
each,  and  Italy  10  percent  of  the  program 
costs. 

The  U.S.  political  and  funding  environ¬ 


ment  for  the  program  is  not  completely 
supportive  or  secure.  The  key  Congres¬ 
sional  committees  have  serious,  funda¬ 
mental  questions  about  whether  or  not  the 
requirement  for  the  CorpsSAM  and  now 
MEADS  can  be  satisfied  more  cheaply 
and  at  lower  risk  with  a  hybrid  of  the  PA¬ 
TRIOT  (Pac  3)  and  the  Theater  High  Al¬ 
titude  Area  Defense  systems,  or  with  the 
range  and  altitude  improvements  being 
made  to  the  HAWK  system — HAWK  III. 

Affordability  is  a  major  issue  with  six 
ongoing  ballistic  missile  defense  pro¬ 
grams.  There  are  also  concerns  about  “re¬ 
inventing  the  wheel”  in  MEADS  and  not 
using  pertinent  technology  from  other  pro¬ 
grams  well  under  way.  During  1 995,  while 
the  Defense  Department  was  negotiating 
internationally  on  the  MEADS  program. 
Congressional  committees  completely  cut 
fiscal  year  1996  funding  for  the 
CorpsSAM.  Congress  then  reinstated 
some  funding  after  numerous  letters  of 
support  came  from  key  Defense  quarters 
(CINCs,  JCS,  etc.). 

Four  Countries  and 

Six  Companies  Wili  Be  Involved 

As  in  the  MLRS/TGW  program, 
MEADS  involves  four  government  part¬ 
ners  in  a  highly  complex  development  ef¬ 
fort.  MEADS  also  uses  six-member  con¬ 
tractor  teams,  versus  the  four-member 
MLRS/TGW  team.  During  the  first 
phase — Project  Definition- Validation — 
two  U.S.  contractors  and  teams  will  be 
competing  against  each  other.  The  two 
U.S.  competitors  will  be  linked  with  A  and 
B  teams  from  the  same  European  compa¬ 
nies.  The  European  companies  have 
formed  a  consortium  called  “Euro- 
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TEAM  A 

COUNTRY 

TEAM  B 

HUGHES-RAYTHEON 

UNITED  STATES 

LOCKHEED  MARTIN 

SIEMENS 

GERMANY 

SIEMENS 

DEUTSCHE  AEROSPACE 

GERMANY 

DEUTSCHE  AEROSPACE 

THOMSON  CSF 

FRANCE 

THOMSON  CSF 

AEROSPATIALE 

FRANCE 

AEROSPATIALE 

ALENIA 

ITALY 

ALENIA 

SOURCE:  DEPARTMENT  OF  DEFENSE,  BALLISTIC  MISSILE  DEFENSE  ORGANIZATION 

Figure  2. 

Competing  Teams  for  MEADS  ProiecI  Definition-Validation  Phase 


MEADS.”  Figure  2  illustrates  the  arrange¬ 
ment  envisioned  for  this  phase. 

With  six  companies  involved,  and  the 
defense  industrial  stakes  high  for  all  four 
countries,  MEADS  will  probably  involve 
a  higher  degree  of  complexity  and  diffi¬ 
culty  for  program  management  as  com¬ 
pared  to  the  MLRS/TGW. 

Full  Agreement  on  Detailed 
Requirements  Remains  A  Goal 


The  United  States  and  Germany  appear 
to  have  one  set  of  requirements  for 
MEADS,  while  France  and  Italy  seem  to 
have  another.  Critical  issues,  including  the 
ballistic  missile  defensive  capability  of  the 
system,  remain  unresolved  between  the 
U.S. -German  requirements  and  the 
French-Italian  requirements.  The  National 
Institute  for  Public  Policy  recently  com¬ 
pleted  a  study  of  the  differing  perspectives 
of  MEADS  among  United  States  and  Eu¬ 
ropean  representatives,  indicating  a  wide 
gulf  between  the  two  groups  (United 
States-Germany  versus  France-Italy)  on 
the  military  function  of  MEADS  and  its 
origins.  The  United  States  and  Germany 


apparently  are  working  from  the  U.S. 
CorpsSAM  concept,  adjusted  for  certain 
German-unique  considerations.  France 
and  Italy,  on  the  other  hand,  seem  to  be 
wedded  to  an  upgraded  version  of  the 
SAMP-T.  This  raises  the  risk  that,  France 
and  Italy  may  leave  the  MEADS  program 
and  apply  some  MEADS  technical  con¬ 
cepts  to  their  preferred  European  system. 
However,  without  German  funding  and 
participation,  they  are  unlikely  to  be  able 
to  proceed.  Germany  appears  to  be  piv¬ 
otal  to  success  for  both  the  United  States 
and  European  program  concepts. 

A  critical  test  will  come  in  the  form  of 
the  Request  For  Proposal  (RFP)  that  will 
be  issued  to  the  two  industrial  teams.  The 
RFP  presumably  will  be  based  on  a  NATO 
Supreme  Headquarters  Allied  Powers 
Europe  military  operational  requirements 
document  that  was  drafted  but,  as  of  Janu¬ 
ary  1996,  not  yet  approved  by  the  North 
Atlantic  Council.  The  Request  for  Pro¬ 
posal  must  contain  sufficient  information 
on  the  operational  requirements  for  the 
teams  to  provide  the  deliverables.  Accord¬ 
ing  to  Defense  Department  officials,  the 
deliverables  will  be  a  set  of  specifications 
and  a  cooperative  plan  for  developing  and 
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producing  the  system.  This  phase  will  also 
involve  some  limited  hardware  and  simu¬ 
lation  deliver-ables. 

Will  the  Right  Companies  Do 
THE  Right  Development  Work? 

Three  U.S.  teams  were  competing  for 
the  CorpsSAM  program:  a  Hughes- 
Raytheon  team,  Lockheed  Martin,  and  a 
Loral-TRW-Westinghouse  team.  The 
Loral  team  was  eliminated  from  the  com¬ 
petition  in  an  October  1995  Defense  De¬ 
partment  decision.  This  left  Hughes- 
Raytheon  and  Lockheed  Martin  to  com¬ 
pete  from  the  United  States  during  the  first 
phase  of  the  MEADS  program.  Accord¬ 
ing  to  Defense  officials,  the  plan  is  to  di¬ 
vide  work  share  in  accordance  with  cost 
share,  as  in  the  MLRS/TGW  program. 

How  were  the  European  companies  se¬ 
lected  to  participate  in  the  critical  Project 
Definition-Validation  Phase?  One  U.S.  in¬ 
terviewee  noted  that  the  European  com¬ 
panies  were  selected  by  their  governments 
because  they  were  the  only  ones  that  could 
do  the  development  and  production  work 
at  the  system  level.  In  any  case,  the  ap¬ 
proach  of  using  two  core  teams  from  the 
same  European  companies  seems  to  avoid 
one  cause  of  problems  encountered  in  the 
MLRS/TGW  program.  The  “favorite” 
European  companies  apparently  were  se¬ 
lected  up  front.  If  they  are  the  strongest 
technologically  for  MEADS  those  nations 
have  to  offer,  the  risk  of  technical  prob¬ 
lems  affecting  cost,  schedule,  and  perfor¬ 
mance  is  reduced.  In  other  words,  there  is 
no  risk  that  weak  contractors  will  partici¬ 
pate  in  this  phase  of  the  program. 

Still,  the  risks  to  success  will  be  increased 
unless  technical  work  share  is  determined 


truly  on  the  basis  of  technological  strengths 
and  experience  each  company  brings  to  the 
program.  It  is  too  early  in  the  program  to 
determine  how  technical  work  share  will 
be  divided  among  the  companies  in  any 
detail.  All  the  companies  involved  in  the 
program  appear  to  be  experienced  and 
capable  for  certain  development  tasks.  The 
U.S.  companies  are  already  involved  in 
the  PATRIOT  and  Theater  High  Altitude 
Area  Defense  programs.  Siemens  is  a  pre¬ 
mier  communications  company,  making 
it  likely  to  be  heavily  involved  in  the 
battlefield  management  center  concept  for 
the  MEADS.  Deutsche  Aerospace, 
Thomson  CSF,  Aero-spatiale,  and  Alenia 
are  engaged  in  various  European  national 
and  cooperative  missile  programs. 

One  source  noted  that  the  draft  Memo¬ 
randum  of  Understanding  (MOU)  will 
provide  that  the  work  share  will  be  equiva¬ 
lent  to  the  cost  share,  that  this  will  be  based 
on  fixed,  negotiated  exchange  rates  as  ref¬ 
erence  points  for  calculating  work-share 
value,  and  that  work-share  calculations 
will  be  determined  to  the  second  tier  on  a 
nation-by-nation  basis.  This  is  similar  to 
the  MLRS/TGW  program.  What  is  differ¬ 
ent  is  that  the  agreement  would  allow  work 
share  at  the  second  tier  to  be  subcontracted 
across  nations  with  approval  of  the  steer¬ 
ing  committee.  This  provision  would  be 
used,  for  example,  if  a  particular  company 
could  not  perform  its  work  share.  If  not 
carefully  managed,  though,  it  is  possible 
that  from  a  given  country’s  perspective,  it 
may  not  ultimately  get  a  work  share  com¬ 
mensurate  with  its  cost  share.  The  agree¬ 
ment  essentially  provides  that  since  the 
program  will  use  a  fixed  price  contract,  any 
cost  overmns  presumably  will  be  absorbed 
by  the  company  that  experiences  them. 

As  experience  in  the  MLRS/TGW  pro- 
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gram  showed,  technical  work  shares 
should  not  be  determined  primarily  on  the 
basis  of  their  desirability  and  equitability, 
but  rather  on  the  basis  of  the  companies’ 
current  technological  strengths  and  capa¬ 
bilities.  In  short,  work  shares  should  not  be 
driven  by  what  will  be  best  for  the  compa¬ 
nies  ’  development,  but  by  what  will  be  best 
for  the  program  and  the  system ’s  develop¬ 
ment.  This  is  not  to  say  that  work  shares 
should  not  be  determined — to  the  great¬ 
est  extent  practicable — with  fairness  in 
terms  of  desirability  and  cost  shares. 

According  to  one  interviewee,  produc¬ 
tion  work  shares  will  pose  the  most  diffi¬ 
cult  problem.  For  example,  the  con- 
tractor(s)  who  have  integration  and  soft¬ 
ware  tasks  during  the  development  pro¬ 
gram  will  need  more  in  production  work 
to  ensure  equitableness.  As  a  result,  some 
companies  who  designed  and  developed 
hardware  in  the  program  will  have  to  give 
up  a  piece  of  the  production  work  to  oth¬ 
ers.  Program  officials  believed,  however, 
this  was  a  workable  issue,  as  the  stakes 
are  high  for  all  the  partners  to  make  this 
program  successful. 

The  political  posturing  and  mistrust 
over  who  gets  quality  MEADS  technical 
work  shares,  however,  appears  to  have 
already  begun.  While  some  sources  indi¬ 
cate  the  companies  are  postured  for  coop¬ 
eration,  they  also  indicate  concerns  about 
the  governments’  ability  to  work  together. 
One  source  notes  German  experts  are  con¬ 
cerned  the  United  States  is  not  really  will¬ 
ing  to  cooperate  in  the  spirit  of  partner¬ 
ship  and  is  interested  only  in  selling  black 
boxes.  The  National  Institute  for  Public 
Policy  study  of  European  impressions  of 
MEADS  is  replete  with  indications  of 
European  mistrust  of  U.S.  government  and 
industry,  work-share  arrangements,  and 


U.S,  technical  requirements  the  Europe¬ 
ans  do  not  want  but  will  be  asked  to  fi¬ 
nance,  etc. 

One  Production  Line  or  Two? 


Finally,  the  issue  of  production  and  fi¬ 
nal  assembly  lines  has  been  only  partially 
addressed.  Apparently,  the  partners  envi¬ 
sion  that  there  will  be  single  sources  for 
the  various  components,  but  that  it  is  pos¬ 
sible  that  there  may  be  more  than  one  fi¬ 
nal  assembly  and  integration  line.  One 
interviewee  noted  that  this  will  not  com¬ 
pletely  obviate  economies  of  scale  to  be 
achieved,  as  the  greatest  costs  are  in  pro¬ 
ducing  components  in  duplicative  facili¬ 
ties.  It  remains  unclear,  however,  whether 
or  not  the  United  States  and  Europe  will 
want  to  produce  critical  components,  such 
as  seekers  and  guidance  sections,  domes¬ 
tically  for  national  security  reasons.  In  ad¬ 
dition,  decisions  about  how  to  handle  third 
party  transfers  and  sales  of  hardware  have 
been  left  for  future  negotiations.  For  now, 
all  foreground  data  transfers  and  uses  for 
non-MEADS  programs  are  subject  to 
unanimous  consent  by  the  partners. 

The  Partners  Currently  Plan  to  Have  A 
Consortium— Not  a  Prime  Contractor 

Defense  officials  indicate  there  is  cur¬ 
rently  no  plan  to  have  a  prime  contractor, 
and  that  the  companies  will  form  a  con¬ 
sortium,  as  MDTT,  Inc.,  did  for  the 
MLRS/TGW.  One  source  indicated  that 
the  governments  support  the  consortium 
approach  to  maintain  fairness  among  the 
partners.  The  sources  did  not  indicate  how 
they  would  overcome  the  problems  caused 
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by  the  lack  of  a  prime  contractor  experi¬ 
enced  in  the  MLRS/TGW. 

If  the  MLRS/TGW  program  experience 
is  a  good  teacher,  the  MEADS  partners 
will  change  course  and  assign  a  prime 
contractor.  If  not,  at  the  very  least,  they 
could  establish  a  “lead”  company  in  the 
consortium.  The  “lead”  company  would 
be  the  source  of  authority,  responsibility, 
and  accountability  for  the  contractors’ 
work.  The  lead  company  would  also  track 
progress,  determine  risk  areas,  and  per¬ 
form  other  management  functions.  In  any 
case,  the  governments,  companies,  and — 
most  of  all — the  program  would  be  well- 
served  to  set  up  the  consortium  in  a  man¬ 
ner  that  permits  equitable  partnership,  but 
ensures  contractor  accountability,  respon¬ 
sibility,  and  leadership. 

Will  thi  Program  Have  a  Fully-Staffed, 
Full-Fledged  International  Project 
Office? 


The  MEADS  will  be  managed  by  the 
NATO  MEADS  Management  Agency,  an 


international  program  office  chartered  by 
NATO.  The  agency  will  be  located  in 
Huntsville,  AL.  Current  planning,  reflected 
in  Figure  3,  is  that  there  will  be  a  multina¬ 
tional  Program  Executive  Office-level 
Steering  Committee.  The  U.S.  Missile  De¬ 
fense  Program  Executive  Office  (flag  of¬ 
ficer)  and  its  European  counterparts  will 
be  members  of  the  Steering  Committee. 
This  Committee  will  have  authority  over 
the  NATO  MEADS  Management  Agency. 
The  General  Manager  position  of  this 
agency  will  rotate  among  European  rep¬ 
resentatives  throughout  the  entire  MEADS 
program.  Germany  will  provide  the  Gen¬ 
eral  Manager  for  the  project  definition- 
validation  phase.  Throughout  all  phases 
of  the  program,  the  United  States  will  pro¬ 
vide  the  permanent  Deputy  General  Man¬ 
ager.  In  view  of  the  50  percent  U.S.  fund¬ 
ing  share,  this  was  apparently  a  U.S.  com¬ 
promise  arrangement  arrived  at  in  the  ne¬ 
gotiations. 

The  MLRS/TGW  experience  demon¬ 
strated  the  importance  of  having  a  truly 
international  project  office,  with  principals 
who  have  deciison  making  authority  from 


Figure  3.  Planned  MEADS  Profect  Management  Organization 
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all  quarters  living  together  to  make  a  suc¬ 
cessful  program.  It  remains  unclear  how 
quickly  and  how  fully  the  NATO  MEADS 
agency  will  be  staffed,  and  with  what  au¬ 
thority  its  personnel  will  manage  and  over¬ 
see  the  program.  The  United  States  will 
continue  to  have  a  small  (10-person)  na¬ 
tional  project  office,  located  in  Huntsville. 
Will  the  Europeans  maintain  their  national 
program  offices,  and  retain  all  authority 
in  their  national  capitals  for  decision  mak¬ 
ing  on  tradeoffs,  etc.,  that  will  inevitably 
arise? 

How  Will  Decision  Making  Be  Done? 

Interviewees  were  uncertain  about  how 
decision  making  would  be  done  in  the  pro¬ 
gram,  both  on  the  parts  of  the  companies 
and  the  governments.  They  speculated, 
however,  that  a  consensual  approach  was 


likely.  One  interviewee  stated  that  the  pro¬ 
gram  would  be  managed  and  decision 
making  would  be  on  a  “50:50  basis”  in  a 
true  equitable  partnership  between  the 
United  States  and  the  European  allies. 
However,  another  noted  that  European 
block  voting  was  already  occurring  on 
many  issues  during  the  negotiations,  with 
Germany  playing  the  swing  vote  in  some 
issues  with  the  United  States. 


A  Comparative  Snapshot 


As  shown  in  Eigure  4,  in  some  key  pro¬ 
gram  areas,  the  MEADS  partners  are  fol¬ 
lowing  a  path  that  is  similar  to  the  MLRS/ 
TGW  program.  Having  four  governments 
and — even  more  complicated — six  com¬ 
panies  involved  in  the  program  will  likely 
be  problematic  and  costly.  Through  un¬ 
usual  teaming  arrangements,  MEADS 


PROGRAM  CHARACTERISTICS 

MLRS/TGW 

MEADS 

Number  of  Countries/Companies 

Four/Four 

Four/Six 

Mix  of  Countries 

U.S.,  FR,  GE,  U.K. 

U.S,  FR,  GE,  IT 

Percentage  Cost  Shares 

40:20:20:20 

50:20:20:10 

Agreement  on  Threat  Details 

Not  Fully 

Not  Yet 

Contractor  Selection 

Winning  Multinational 
Team  with 

Some  Weak  Players 

U.S.  Companies 
Compete;  Same  Strong 
European  Companies 

Win 

Prime  Contractor  or  Consortium 

Consortium 

Consortium 

Work  Share  Based  on  Cost  Share 

Yes-to  Second  Tier 

Yes-to  Second  Tier 

Work  Share  Based  on  Company  Strengths 

Not  Adequately 

Unknown 

Fully  Staffed,  Full-Fledged  Int.  Prog.  Office 

No 

Unknown 

Governments’  Decision  Making 

Consensus;  Single 

Vote  Veto 

Possibly 

Consensus 

Companies’  Decision  Making 

Consensus- 
Governments  Involved 

Unknown 

Figure  4. 

Comparison  of  Program  Characteristics  in  MLRS/TGW  and  MEADS 
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partners  have  avoided  the  possibility  of 
having  weak  companies  participating  in 
the  program.  However,  having  six  com¬ 
panies  operating  in  a  consortium  could 
lead  to  similar  difficulties  encountered  in 
the  MLRS/TGW  program  if  leadership 
and  accountability  are  not  established. 
Moreover,  some  observers  believe  the 
MEADS  program  is  already  doomed  to 
failure  because  the  partners  clearly  do  not 
agree  on  key  elements  of  the  requirements. 
However,  if  a  prime  contractor,  lead  com¬ 
pany  or  similar  approach  is  taken,  and  if 
the  countries  can  harmonize  their  require¬ 
ments  or  even  agree  on  a  formula  for  fenc¬ 
ing  off  development  and  funding  some  of 
the  requirements  that  are  beyond  France 
and  Italy’s  interests,  MEADS  has  a  chance 
for  success. 

The  MEADS  partners  are  still  in  the 
early  stages  of  establishing  a  cooperative 
program  and  can  possibly  benefit  from  the 
MLRS/TGW  program  experience.  Front- 
end  “damage  limitation”  can  be  applied 
in  the  areas  in  which  decisions  have  not 
yet  been  made:  determining  technical 
work  shares;  staffing  and  decision  mak¬ 
ing  power  in  the  international  program 
office;  and  determining  the  approach  to 
decision  making  both  among  the  govern¬ 
ments  and  the  companies  involved.  If  the 
program  fails,  damage  to  the  political  re¬ 
lationships  will  likely  be  serious — it  is  in 
all  the  partner  nations’ interests  to  do  what 
makes  sense  for  the  program. 

Conclusions 


The  MEADS  partners  can  avoid  some 
major  pitfalls  encountered  in  the  MLRS/ 
TGW  experience  if  they: 


•  either  get  full  agreement  on  a  detailed 
set  of  requirements  up  front  or  fence 
off  development  and  funding  (and  as¬ 
sociated  work  shares)  of  requirements 
on  which  agreement  cannot  be 
reached; 

•  establish  a  prime  contractor  or  a  lead 
company/manager  for  the  consortium; 

•  ensure  technical  work  shares  are  eq¬ 
uitably  based  on  national  cost  shares 
and  the  companies’  technological 
strengths,  experience,  and  compara¬ 
tive  advantages; 

•  quickly  establish  a  fully-staffed,  full- 
fledged  international  program  office 
vested  with  national  program  office- 
level  decision  making  power  and  au¬ 
thority;  and 

•  avoid  consensus  decision  making  in 
which  negative  behaviors,  such  as 
single-vote  veto,  are  available  and  can 
stop  the  program — adopt  another, 
more  positive  team-oriented  ap¬ 
proach. 

The  former  United  States, United  King¬ 
dom,  French,  and  German  MLRS/TGW 
program  officials  and  the  current  United 
States,  French,  German,  and  Italian 
MEADS  program  officials  should  hold  a 
joint  conference  to  more  fully  explore  the 
problems  encountered  in  the  MLRS/TGW 
program,  their  causes,  and  alternative  ap¬ 
proaches  to  better  ensure  success  for 
MEADS. 
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SPECIFICATION, 
HARMONIZATION, 
AND  lINKAGE  OF 
TEST  PARAMETERS 


Edward  D»  Jones 


This  article  addresses  how  to  best  specify  “what  to  test”  parameters.  It  will 
also  clarify  the  latest  DoD  5000  series  guidance  as  approved  by  the  Secretary 
of  Defense  on  9  March  1996  on  the  establishment  and  maintenance  of 
parameter  linkage  and  harmonization  among  the  key  acquisition  documents. 


While  the  newly  revised  Depart¬ 
ment  of  Defense  (DoD)  5000  se¬ 
ries  does  make  significant 
progress  implementing  acquisition  reform, 
confusion  will  likely  continue  to  exist  in 
the  test  and  evaluation  arena  as  to  how  to 
best  specify  test  parameters  for  an  acqui¬ 
sition  program  (Figure  1). 

A  proliferation  of  “what  to  test”  termi¬ 
nology  remains  among  the  various  parts 
of  the  DoD  5000  series.  A  formal  glos¬ 
sary  that  will  perhaps  define  these  terms 
is  still  being  compiled.  On  pages  149-151 
is  a  partial  listing  of  “what  to  test”  termi¬ 
nology  used  in  this  article.  For  purposes 
of  brevity,  acronyms  may  not  be  defined 
except  in  this  terminology  list.  Braces  and 
brackets  indicate  an  acquisition  document 
where  the  term  is  used. 


"What  To  Test" 


Some  of  the  “what  to  test”  terms  may 
refer  to  the  same  required  capabilities  and 
associated  thresholds  and  objectives.  Of¬ 
ten,  they  do  not.  Inherent  relationships  or 
linkages  are  not  specified  for  most  of  these 
terms.  Figure  2  summarizes  the  DoD  5000 
series  mandated  sources  for  the  most  im¬ 
portant  “what  to  test”  parameters. 

The  proper  usage  of  “what  to  test”  terms 
in  reports  and  in  discussions  with  over¬ 
sight  agencies  can  be  important.  Some  of 
the  terms  have  their  origin  in  Title  1 0  law. 
For  example,  effectiveness  and  suitabil¬ 
ity  are  addressed  in  legislation  that  man¬ 
dates  how  we  will  conduct  dedicated  ini¬ 
tial  operational  test  and  evaluation.  The 
test  manager  and  program  manager  must 
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take  care  when  discussing  what  is  actu¬ 
ally  being  tested  or  evaluated.  For  ex¬ 
ample,  assume  a  test  for  an  ACAT  ID  ac¬ 
quisition  program  indicates  that  a  thresh¬ 
old  is  not  achieved  for  a  TPM  that  is  also 
a  specified  exit  criteria. 

Who  has  oversight  for  these  test  param¬ 
eters?  The  contractor  and  government 
technical  managers  have  oversight  over 
TPMs.  Unless  the  TPM  is  also  designated 
as  a  critical  technical  parameter,  it  will  not 
be  listed  in  the  TEMP  and  will  normally 
not  be  subjected  to  Office  of  the  Secre¬ 
tary  of  Defense  (OSD)  oversight  at  the 
overarching  Integrated  Product  Team 
(IPT)  level.  However,  all  exit  criteria  by 


definition  are  under  the  direct  oversight 
of  the  milestone  decision  authority 
(MDA).  This  means  that  failure  to  meet 
the  threshold  for  an  exit  criteria  could  pre¬ 
vent  the  acquisition  from  proceeding  into 
the  next  acquisition  phase.  This  could  be 
an  emotional  event!  Compare  this  with  fail¬ 
ing  to  meet  a  threshold  of  TPM  that  is  not  a 
CTP  or  not  specified  to  be  an  exit  criteria. 
The  contractor  and  government  technical 
manager  would  take  appropriate  actions  to 
solve  the  problem  under  the  oversight  of  the 
program  manger  and  the  appropriate  work¬ 
ing  level  IPT.  This  article  will  recommend 
a  method  to  specify  test  parameters  that  sim¬ 
plifies  the  “what  to  test”  terminology. 


LTC  Edward  D.  Jones  presently  serves  as  a  professor  of  engineering  management  at  the 
Defense  Systems  Management  College,  Fort  Belvoir,  VA.  Jones  received  his  B.S.  degree  from 
the  U.S.  Military  Academy  in  1974  and  a  M.S.  degree  in  chemical  engineering  from  Vanderbilt 
University  in  1987. 
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"What  To  Test"  Terminology 


Compatibility,  Interoperability,  and  Inte¬ 
gration  (CII)  Issues.  {Appendix  III,  DoD 
REGULATION  5000.2-R}  Defined  to  be 
critical  operational  issues  that  address  com¬ 
patibility,  interoperability  or  integration  is¬ 
sues.  [Test  and  Evaluation  Master  Plan  or 
TEMP] 

Critical  Operational  Issue  (COI).  {Appen¬ 
dix  III,  DoD  REGULATION  5000.2-R}  A 
question  that  must  be  answered  in  order  to 
properly  evaluate  operational  effectiveness 
and  operational  suitability  for  a  system. 
[TEMP] 

Critical  Operational  Effectiveness  and 
Suitability  Parameters  and  Constraints. 
{Appendix  III,  DoD  REGULATION 
5000.2-R}  Parameters  and  constraints  as 
specified  in  the  ORD  that  address  manpower, 
personnel,  training,  software,  computer  re¬ 
sources,  transportation  (lift),  compatibility, 
interoperability,  and  integration,  etc.  These 
parameters  and  constraints  are  included  in 
the  listing  of  measures  of  effectiveness  and 
suitability  in  Part  I  of  the  TEMP.  [TEMP, 
ORD] 

Critical  Technical  Parameter  (CTP).  {Ap¬ 
pendix  III,  DoD  REGULATION  5000.2-R} 
Not  defined.  They  are  to  be  derived  from 
the  ORD,  critical  system  characteristics,  and 
technical  performance  measurements  and 
should  include  the  parameters  in  the  acqui¬ 
sition  program  baseline.  [TEMP] 

Exit  Criteria.  [Paragraph  3.2.3,  DoD 
REGULATION  5000.2-R]  Exit  criteria  are 
some  level  of  demonstrated  performance 
(e.g.,  a  level  of  engine  thrust),  the  accom¬ 
plishment  of  some  process  at  some  level  of 
efficiency  (e.g.,  manufacturing  yield)  or  suc¬ 
cessful  accomplishment  of  some  event  (e.g.. 


first  flight),  or  some  other  criterion  (e.g.,  es¬ 
tablishment  of  a  training  program  or  inclu¬ 
sion  of  a  particular  clause  in  the  follow-on 
contract)  that  indicates  that  aspect  of  the  pro¬ 
gram  is  progressing  satisfactorily.  [ADM] 

Indicators.  [Paragraph  3.4.3,  DoD  REGU¬ 
LATION  5000.2-R}  One  or  more  measure¬ 
ments  that  provide  insight  when  compared 
with  test-established  thresholds.  [Not  man¬ 
dated  for  usage  in  any  key  acquisition  docu¬ 
ment;  however,  frequently  used  in  test  re¬ 
ports  and  program  assessments.] 

Key  Performance  Parameter  (KPP). 
[Paragraph  2.3,  DoD  REGULATION 
5000.2-R}  Acapability  or  characteristic  that 
is  so  significant  that  failure  to  meet  the 
threshold  can  be  cause  for  the  concept  of 
system  selection  to  be  reevaluated  or  the 
program  to  be  reassessed  or  terminated. 
[ORD,  TEMP,  Aquisition  Program  Baseline 
or  APB] 

Measures.  { Used  through  out  DoD  5000  se¬ 
ries]  Not  defined.  As  defined  in  IEEE 
1278.3,  a  qualitative  or  quantitative  attribute 
used  to  ascertain  or  appraise  by  comparing  to 
a  standard.  [TEMP,  Analysis  of  Alternatives] 

Measures  of  Effectiveness  and  Suitability 
(MOEs/MOSs).  [Appendix  III,  DoD 
REGULATION  5000.2-R  and  in  other  parts } 
The  following  definition  is  inferred  from  a 
discussion  of  measures  of  effectiveness  and 
suitability  in  Appendix  III.  The  operational 
performance  (effectiveness  and  suitability) 
parameters  that  specify  capabilities,  charac¬ 
teristics,  and  constraints  as  identified  in  the 
ORD.  Each  measure  of  effectiveness  and 
suitability  is  to  have  a  threshold  and  an  ob¬ 
jective.  [TEMP,  Analysis  of  Alternatives, 
ORD] 
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"What  To  Test"  Terminology  (continued) 


Measure  of  Performance  (MOP).  { Para¬ 
graph  3.4.1;  Appendix  III,  DoD  REGULA¬ 
TION  5000. 2-R}  Not  defined.  A  commonly 
accepted  definition  is:  a  measure,  such  as 
weight  and  speed,  that  relates  to  a  measure 
of  effectiveness  such  that  the  effect  of  a 
change  in  the  measure  of  performance  can 
be  related  to  a  change  in  the  measure  of  ef¬ 
fectiveness.  { 1992  OUSD  (A&T)  memoran¬ 
dum;  subject:  Implementation  Guidelines  for 
Relating  Cost  and  Operational  Effectiveness 
Analysis  (COEA)  Measure  of  Effectiveness 
to  test  and  evaluation. }  [TEMP,  ORD  Analy¬ 
sis  of  Alternatives] 

Metrics.  (Paragraph  4.3,  DoD  REGULA¬ 
TION  5000.2-R}  Not  defined.  As  defined 
in  Webster’s  Dictionary,  metrics  is  the  ex¬ 
tent  or  degree  to  which  a  product  possesses 
and  exhibits  a  quality,  or  property,  or  an  at¬ 
tribute.  This  term  is  more  commonly  used 
when  addressing  software  testing  and  evalu¬ 
ation.  [TEMP] 

Minimum  Acceptable  Requirements. 

[Paragraph  2.3,  DoD  REGULATION 
5000.2-R}  While  not  specifically  defined, 
it  can  be  logically  inferred  that  minimum  ac¬ 
ceptable  requirements  are  the  minimum  ca¬ 
pabilities  and  characteristics  that  a  system 
must  possess  in  order  to  successfully  accom¬ 
plish  all  mission  essential  tasks.  [ORD] 

Objective.  [Paragraph  2.3.2,  DoD  REGU¬ 
LATION  5000.2-R}  The  objective  value  is 
that  desired  by  the  user  and  which  the  PM  is 
contracting  for  or  otherwise  attempting  to 
obtain.  The  objective  value  could  represent 
an  operationally  meaningful,  time  critical, 
and  cost  effective  increment  above  the 
threshold  for  each  program  parameter. 
[TEMP,  ORD,  APB] 


Operational  Performance  Parameters. 

(Appendix  II,  DoD  REGULATION  5000.2- 
R}  These  are  system  level  performance  ca¬ 
pabilities  such  as  range,  probability  of  kill, 
platform  survivability,  operational  availabil¬ 
ity,  etc.  Each  parameter  should  have  an  ob¬ 
jective  and  threshold.  [ORD] 

Other  Systems  Characteristics.  (Appen¬ 
dix  II,  DoD  REGULATION  5000.2-R}  A 
special  category  of  characteristics  that  tend 
to  be  design,  cost,  and  risk  drivers.  Examples 
include  electronic  counter-countermeasures 
(ECCM)  and  Wartime  Reserve  Modes 
(WARM)  requirements  and  others  as  listed 
in  Appendix  II  of  DoD  REGULATION 
5000.2-R.  [ORD] 

Parameter.  (DoD  REGULATION  5000.2- 
R}  This  term  is  liberally  used  throughout  the 
DoD  5000  series.  It  is  not  defined.  As  de¬ 
fined  in  the  American  Heritage  Dictionary, 
a  parameter  is  a  variable  or  an  arbitrary  con¬ 
stant  appearing  in  a  mathematical  expres¬ 
sion,  each  value  of  which  restricts  or  deter¬ 
mines  the  specific  form  of  the  expression. 
Current  usage  in  the  DoD  5000  series  and  in 
other  current  literature  used  by  the  test  com¬ 
munity  have  broadened  the  definition  to  be 
equivalent  to  any  test  variable,  whether  for¬ 
mally  part  of  a  mathematical  equation  or  not. 
Probability  of  hit  is  one  example  that  does 
meet  the  technical  definition  of  a  parameter. 
[TEMP,  ORD,  APB] 

Required  Capabilities.  (Used  throughout 
DoD  REGULATION  5000.2-R}  Not  de¬ 
fined.  A  commonly  accepted  definition  is: 
system  performance  or  characteristics  that  a 
system  must  possess  in  order  to  accomplish 
mission  essential  tasks.  [ORD,  TEMP,  APB, 
Analysis  of  alternatives] 
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''What  To  Test"  Terminology  (continued) 


Technical  Performance  Measurement 
(TPM).  { Appendix  III,  DoD  REGULATION 
5000.2-R}  Not  defined.  A  common  defini¬ 
tion  that  is  accepted  in  systems  engineering 
follows:  A  product  design  assessment,  which 
estimates  through  engineering  analysis  & 
tests,  values  of  essential  performance  param¬ 
eters  of  the  current  design  of  a  work  break¬ 
down  structure  product  element.  [SEMP, 
contract] 


Thresholds.  {Paragraph  2.3.2,  DoD  REGU¬ 
LATION  5000.2-R}  These  are  the  minimum 
acceptable  values  which,  in  the  user’s  judg¬ 
ment,  are  necessary  to  satisfy  the  need.  If 
threshold  values  are  not  achieved,  program 
performance  is  seriously  degraded,  the  pro¬ 
gram  may  be  too  costly,  or  the  program  may 
no  longer  be  timely.  The  spread  between  ob¬ 
jective  and  threshold  values  shall  be  indi¬ 
vidually  set  for  each  program  based  on  the 
characteristics  of  the  program  (e.g.,  matu¬ 
rity,  risk,  etc.).  [ORD,  TEMP,  APB] 
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MOE,MOP|  Analysis  of  Alternatives 


Operational  Performance  Parameters 


Unkage 


Performance 


Logistics/Readiness 


Other  System 
Characteristics 


Critical  Operational  lssues(COI) 
{Interoperability  COIs}  :  > 


Figure  2.  "What  to  Test"  Parameter  Sources 


Implementation  Policy  For 
Performance  Parameter  Specification 

The  TEMP  lists  the  “what  to  test”  pa¬ 
rameters,  outlines  the  strategy  to  conduct 
the  testing,  provides  a  summary  of  re¬ 
quired  test  resources,  and  assigns  respon¬ 
sibilities.  Note  that  the  tester  limits  the 
“what  to  test”  terminology  to:  measures 
of  effectiveness,  measures  of  suitability, 
measures  of  performance,  critical  techni¬ 
cal  parameters,  critical  operational  is¬ 
sues,  critical  system  characteristics  and 
compatibility,  inter-operability,  and  inte¬ 
gration  (CII)  issues.  Terms  such  as  soft¬ 
ware  metrics,  operational  performance  pa¬ 
rameters,  system  constraints,  minimum 
required  capability  and  required  capabili¬ 
ties  are  incorporated  into  the  TEMP  as  one 
of  the  preceding  “what  to  test”  parameters, 
measures  or  issues!  How  do  all  the  “what 
to  test”  parameters,  measures,  and  issues 
that  are  commonly  used  by  the  tester  tie 


together?  Figure  3  illustrates  the  relation¬ 
ships  between  the  “what  to  test”  param¬ 
eters  during  operational  testing. 

A  critical  operational  issue  (COI)  ad¬ 
dresses  a  key  operational  effectiveness  or 
operational  suitability  issue  that  must  be 
examined  in  operational  test  and  evalua¬ 
tion  to  determine  the  system’s  capability 
to  perform  its  mission.  The  COI  is  stated 
as  a  question  and  should  address  top  sys¬ 
tem  level  mission  essential  tasks.  MOEs 
provide  (quantitative  whenever  practical) 
criteria  that  can  be  used  to  judge  whether 
a  system  can  effectively  provide  the  re¬ 
quired  capabilities  as  stated  in  the  ORD. 
Each  MOE  should  provide  information 
that  is  to  be  used  to  answer  one  or  more 
effectiveness  COIs.  When  a  COI  ad¬ 
dresses  suitability,  the  measure  of  effec¬ 
tiveness  is  replaced  by  the  MOS.  The 
MOP  is  a  (quantitative  when  practical) 
criteria  for  a  lower  level  of  performance 
that  is  used  to  support  the  determination 
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figure  3.  €OI  1  {Effectiveness  COI} 


or  assessment  of  one  or  more  MOEs  or 
MOSs.  MOEs,  MOSs,  and  MOPs  are  nor¬ 
mally  extracted  directly  from  the  ORD. 
In  some  cases,  they  must  be  derived  from 
the  ORD.  On  an  exceptional  basis,  MOEs, 
MOSs,  and  MOPs  can  be  recommended 
for  testing  by  the  Director  of  Operational 
Test  and  Evaluation  (DOT&E)  or  by  the 
appropriate  component  Operational  Test 
Agency  (OTA).  This  might  occur  when  the 
OTA  or  DOT&E  determine  that  the  re¬ 
quired  capabilities  and  characteristics  are 
not  adequate  for  operational  testing. 
MOEs,  MOSs,  and  MOPs  that  are  not  ex¬ 
tracted  or  derived  from  the  ORD  must  be 
approved  through  the  IPT  process  prior  to 
being  used  for  determination  of  effective¬ 
ness  and  suitability  in  an  independent 
evaluation  report  such  as  the  beyond  low 
rate  initial  production  report.  The  user  will 
establish  thresholds  and  objectives  for  any 
DOT&E  or  OTA  recommended  MOEs, 


MOSs,  and  MOPs. 

COIs  and  operational  performance  pa¬ 
rameters  are  most  appropriately  tested  in 
an  operational  environment.  An  opera¬ 
tional  environment  is  the  same  or  closely 
approximated  environment  that  the  sys¬ 
tem  will  be  used  in  when  issued  to  the  user. 
Testing  in  a  controlled  environment  that 
may  significantly  deviate  from  operational 
conditions  or  testing  that  is  limited  to  a 
specific  set  of  operational  conditions  is 
called  developmental  testing.  Another 
“what  to  test”  parameter  listed  in  the 
TEMP  is  CTP.  While  MOEs  and  MOSs 
are  specified  to  support  the  determination 
of  effectiveness  and  suitability  in  an  op¬ 
erational  environment,  the  CTP  is  speci¬ 
fied  to  measure  progress  in  the  hardware 
and  software  development  to  support  the 
final  product  to  be  used  in  a  fully  opera¬ 
tional  environment.  Developmental  test¬ 
ing  is  normally  the  more  appropriate  type 
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of  testing  for  CTPs.  DoD  guidance  is  that 
the  CTP  may  be  derived  from  the  ORD 
and  critical  system  characteristics  or  cho¬ 
sen  from  the  list  of  technical  performance 
measurements  as  specified  in  the  SEMP 
or  extracted  directly  from  the  contract. 
System  level  TPMs  that  measure  perfor¬ 
mance  essential  to  accomplishment  of 
mission  essential  tasks  should  be  speci¬ 
fied  to  be  CTPs.  A  possible  exception  to 
this  guideline  is  an  extremely  high  risk 
component  level  TPM  that  significantly 
impacts  one  or  more  system  level  TPMs. 

In  the  past,  specification  of  CTPs  ver¬ 
sus  minimum  acceptable  operational  per¬ 
formance  parameters  (MAOPRs)  has  been 
problematic.  For  many  programs,  the  CTP 
and  MAOPR  lists  duplicated  each  other. 
The  problem  arises  because  the  ORD  is 
an  approved  source  for  both  the  MAOPR 
and  the  CTP.  This  issue  remains  in  the 
revised  DoD  5000  series.  The  MAOPR 
has  been  replaced  with  MOEs  and  MOSs. 
When  should  MOEs  and  MOSs  also  be 
CTPs?  This  article  recommends  an  ap¬ 
proach  to  CTP  specification  that  will  mini¬ 
mize  duplication  of  CTPs  and  operational 
performance  parameters  (MOEs,  MOS, 
MOPs)  and,  more  important,  clearly  es¬ 
tablish  a  key  difference  between  opera¬ 
tional  performance  parameters  and  CTPs. 

This  process  is  to  simply  limit  the  speci¬ 
fication  of  CTPs  to  performance  that  is 
contractually  specified.  While  this  recom¬ 
mendation  is  not  specifically  supported  by 
guidance  in  the  DoD  5000  series,  it  is  well 
within  the  guidance  for  parameter  speci¬ 
fication.  For  most  acquisition  programs, 
specified  performance  in  a  contract  is  best 
tested  in  a  controlled  environment  during 
developmental  testing.  TPMs  are  by  defi¬ 
nition  contractually  specified  and  are  al¬ 
ways  a  valid  source  for  CTPs.  When  op¬ 


erational  performance  parameters  are 
specified  in  the  contract,  then  they  should 
normally  be  specified  as  CTPs.  This  rec¬ 
ommendation  will  minimize  duplication 
between  operational  performance  param¬ 
eters  and  CTPs.  The  specification  process 
is  based  on  the  premise  that  operational 
performance  parameters  are  best  tested 
during  operational  testing  while  CTPs  and 
TPMs  are  more  appropriately  tested  dur¬ 
ing  developmental  testing.  This  process 
recognizes  that  some  duplication  will  oc¬ 
cur  between  CTPs  and  operational  perfor¬ 
mance  parameters  and  does  not  restrict  the 
testing  of  each  type  of  test  parameter  in 
either  an  operational,  developmental,  or 
hybrid  mode  of  testing. 

Now  let  us  address  the  concepts  of  pa¬ 
rameter  linkage  and  harmony.  The  con¬ 
cept  of  parameter  linkage  and  harmoni¬ 
zation  was  first  introduced  in  a  March 
1992  memorandum  that  was  signed  by  the 
Under  Secretary  of  Defense  for  Acquisi¬ 
tion,  the  Assistant  Secretary  of  Defense 
(Program  Analysis  and  Evaluation),  and 
the  Director,  Operational  Test  and  Evalu¬ 
ation.  This  memorandum  mandated  that 
the  TEMP  should  document  how  measures 
of  effectiveness  and  measures  of  perfor¬ 
mance  from  the  COEA  will  be  addressed 
in  testing  and  evaluation.  In  the  COEA, 
measures  of  effectiveness  were  to  be  de¬ 
fined  to  measure  operational  capabilities 
in  terms  of  engagement  or  battle  outcomes 
for  weapon  systems.  Measures  of  perfor¬ 
mance  such  as  speed  and  weight  were  to 
be  specified  to  relate  to  the  MOE  such  that 
the  effect  of  a  change  in  the  MOP  can  be 
related  to  a  change  in  the  MOE.  It  further 
mandated  that  the  MOEs,  MOPs,  and  cri¬ 
teria  in  the  ORD,  the  COEA,  the  TEMP, 
and  the  APB  should  be  consistent.  These 
mandates  were  incorporated  into  Part  III 
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of  the  revised  DoDI  5000.2  as  quoted  be¬ 
low: 

Linkage  shall  exist  among  the  vari¬ 
ous  MOEs  and  MOPs  used  in  the 
analysis  of  alternatives  or  ORD,  and 
test  and  evaluation;  in  particular,  the 
MOEs,  MOPs,  and  criteria  in  the 
ORD,  the  analysis  of  alternatives,  the 
TEMP  and  the  APB  shall  be  consis¬ 
tent. 

and 

Both  developmental  and  operational 
testers  shall  be  involved  early  to  en¬ 
sure  that  the  test  program  for  the 
most  promising  alternative  can  sup¬ 
port  the  acquisition  strategy  and  to 
ensure  the  harmonization  of  objec¬ 
tives,  thresholds,  and  measures  of  ef¬ 
fectiveness  (MOEs)  in  the  ORD  and 
TEMP. 

In  the  past,  linkage  was  described  as 
the  process  of  associating  (or  linking) 
measures  of  effectiveness  and  measures 
of  performance  that  were  used  as  inputs 
in  models  and  in  analytic  studies  with  ac¬ 
tual  test  data  and  evaluated  results  that 
were  based  on  actual  test  data.  The  pur¬ 
pose  of  this  association  was  to  ensure  that 
realistic  inputs  were  used  in  models  and 
analytic  studies.  Harmonization  was  the 
process  of  ensuring  consistency  among  the 
all  the  various  measures  and  parameters 
to  include  associated  thresholds  and  ob¬ 
jectives.  The  translation  of  past  guidance 
into  the  new  DoD  5000  series  has  lost 
some  of  the  precision  associated  with  de¬ 
fining  the  linkage  and  harmonization  pro¬ 
cess.  Harmonization  and  linkage  have 
adopted  the  same  meaning,  for  practical 


purposes.  That  meaning  is  consistency. 
This  consistency  has  three  key  ingredients: 

•  agreement  on  thresholds  and  objectives 

for  the  same  measures  and  parameters, 

•  compatibility  of  measures  and  param¬ 
eters,  and 

•  realistic  (consistent  with  test  data)  in¬ 
puts  into  studies  and  models. 

The  concept  of  harmonization  and  link¬ 
age  should  be  considered  to  mean  the  pro¬ 
cess  of  establishing  and  maintaining  con¬ 
sistency  among  all  the  measures,  param¬ 
eters,  and  inputs  to  models  and  analytic 
studies.  This  consistency  must  extend  to 
all  the  key  acquisition  documents  (Figure 
4). 

Harmonization  and  linkage  are  most 
easily  discussed  practical  examples;  three 
follow.  First,  during  an  analysis  of  alter¬ 
natives,  assume  that  the  threshold  speed 
(a  measure  of  performance)  for  an  ar¬ 
mored  vehicle  was  established  to  be  80 
km/h  on  improved  roads.  This  threshold 
speed  might  be  a  significant  input  into  the 
models  and  studies  that  recommended  that 
tank  A  be  the  preferred  alternative.  Then 
assume  that  during  developmental  testing 
of  a  prototype  tank  A,  it  is  discovered  that 
this  type  of  tank  will  not  exceed  73  km/h 
on  improved  roads.  It  is  also  assumed  that 
the  engineering  change  proposals  to  in¬ 
crease  the  speed  to  80  km/h  is  cost  and 
schedule  prohibitive.  For  this  example,  the 
concept  of  linkage  and  harmonization  re¬ 
quires  that  actual  test  data  for  tank  A  on 
speed  on  improved  roads  be  compared 
with  inputs  that  were  used  in  the  models 
and  studies  that  were  used  in  the  analysis 
of  alternatives.  Where  necessary,  previous 
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Figure  4.  Parameter  Consistency  (Harmonization  And  Linkage) 


inputs  (measures  of  effectiveness  and  per¬ 
formance,  system  constraints,  etc.)  must 
be  changed  to  reflect  the  more  realistic  in¬ 
puts  that  are  based  on  actual  test  data.  For 
our  example,  we  would  have  to  estab¬ 
lish  whether  the  lower  threshold  speed 
of  73  km/h  versus  the  earlier  threshold 
of  80  km/h  has  a  significant  impact  on 
the  selection  of  the  preferred  alternative. 

For  a  second  example,  assume  the 
threshold  for  mean  time  between  failure 
(MTBF)  for  a  radio  system  to  be  1250  h. 
The  MTBF  threshold  would  be  listed  in 
the  TEMP,  ORD  and  possibly  in  other  key 
acquisition  documents  such  as  the  APB. 
Assume  the  mean  time  to  repair  (MTTR) 
to  be  specified  as  30  min  at  all  levels  of 
maintenance.  In  the  analysis  of  alterna¬ 
tives,  assume  the  system  to  have  been  re¬ 
quired  to  have  not  more  than  45  min  of 
not  available  time  for  repairs  on  an  an¬ 
nual  basis.  In  the  ORD  or  other  user  docu¬ 


ment,  assume  the  system  to  have  the  re¬ 
quirement  to  be  placed  into  operation  for 
2500  h  on  an  annual  basis.  Now,  the  ques¬ 
tion  to  answer  is:  “Are  these  required  ca¬ 
pabilities  and  associated  parameters  in 
harmony  (consistent)?”  In  this  case,  the 
required  performance  parameters  are  not 
in  harmony.  Simple  math  will  reveal  a  dis¬ 
crepancy.  During  one  year,  the  system 
should  fail  on  average  twice.  Two  times 
30  min  indicates  that,  on  average,  60  min 
of  downtime  should  be  expected  for  this 
system.  This  conclusion  indicates  that  the 
system  should  be  expected  to  have  more 
than  45  min  of  not  available  time  on  an 
annual  basis.  The  “what  to  test”  param¬ 
eters  among  the  TEMP,  ORD,  and  analy¬ 
sis  of  alternatives  are  not  consistent  (har¬ 
monized).  This  problem  can  be  fixed  by 
decreasing  the  mean  time  between  failure 
or  by  increasing  the  threshold  for  the  not 
available  time  from  repairs.  The  preced- 
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ing  example  illustrates  the  compatibility 
aspect  of  consistency. 

The  final  example  illustrates  the  sim¬ 
plest  aspect  of  consistency.  That  is  simple 
agreement  of  thresholds  and  objectives  for 
the  same  operational  performance  param¬ 
eter  or  other  “what  to  test”  parameter. 
Assume  that  the  TEMP  lists  a  MOP  that 
specifies  the  threshold  for  the  probability 
of  hit  for  a  shoulder-launched  missile  to 
be  50%  for  stationary  targets  at  600  m.  In 
the  APB,  assume  the  threshold  for  prob¬ 
ability  of  hit  to  be  60%  for  the  same  con¬ 
ditions.  To  establish  consistency,  the  prob¬ 
ability  of  hit  thresholds  in  the  TEMP  and 
APB  must  be  the  same  for  stationary  tar¬ 
gets  at  600  m. 

Now  that  we  have  discussed  the  “what 
to  test”  terminology  and  the  concepts  of  link¬ 
age  and  harmonization,  it  is  how  time  to 
establish  an  orderly  and  efficient  process  to 
effectively  specify  “what  to  test”  parameters 
and  to  establish  consistency  (harmony  and 
linkage)  among  measures,  parameters,  and 


inputs  for  models  and  analytic  studies  (Fig¬ 
ure  5). 

Test  Parameter  Selection, 

Linkage,  and  Harmonization 


Step  one.  Establish  a  working-level  IPT 
(analysis  of  alternatives/requirements/ 
what  to  test)  that: 

•  specifies  the  required  capabilities  and 
operational  performance  parameters 
with  associated  thresholds  and  objec¬ 
tives  in  the  initial  ORD  and  the  pre¬ 
liminary  TEMP, 

•  inputs  the  required  capabilities  and  as¬ 
sociated  operational  performance  pa¬ 
rameters  for  each  alternative  consid¬ 
ered  in  an  analysis  of  alternatives, 

•  recommends  performance  parameters 
to  be  used  in  the  draft  APB, 


STEP  ONE: 

ESTABLISH  IPT. 

STEP  TWO: 

DRAFT  ORD. 

STEP  THREE: 

SPECIFY  COI  ANDCII. 

STEP  FOUR: 

SPECIFY  MOEs  AND  MOSs 

STEP  FIVE: 

INPUT  TO  APB. 

STEP  SIX: 

SPECIFY  CTPs. 

STEP  SEVEN: 

PREPARE  PARAMETER  DENDRITIC. 

STEP  EIGHT: 

PREPARE  CONSISTENCY  MATRIX. 

Figure  5.  Eight-Step  Process  to  Specify  "What  to  Test"  Parameters 
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•  specifies  the  CTPs  for  the  draft  TEMP, 
and 

•  establishes  and  maintains  consistency 
(linkage  and  harmonization)  for  all 
“what  to  test”  parameters  and  criteria 
among  all  key  acquisition  documents. 
(APB,  TEMP,  Analysis  of  Alternatives, 
ORD,  SEMP  [if  applicable]). 

IPT  membership  should  include  repre¬ 
sentatives  from  the  (1)  user,  (2)  material 
developer,  (3)  operational  tester  ,  (4)  de¬ 
velopmental  tester,  (5)  agency  tasked  to 
conduct  analysis  of  alternatives,  (6)  logis¬ 
tics  support  agency,  and  others  as  appro¬ 
priate.  This  IPT  could  be  assigned  the  task 
of  actually  conducting  the  analysis  of  al¬ 
ternatives  or  be  placed  in  support  of  an¬ 
other  IPT  that  will  perform  the  analysis 
of  alternatives.  In  theory  (in  practice  all 
the  key  acquisition  documents  are  often 
prepared  simultaneously),  the  analysis  of 
alternatives  is  normally  the  first  document 
to  be  drafted.  The  operational  performance 
parameters  that  are  used  in  the  analysis  of 
alternatives  should  not  be  system  specific 
but  should  be  applicable  for  all  alterna¬ 
tives.  The  tester  has  the  important  role  in 
this  process  of  providing  input  as  to  how 
to  properly  state  required  capabilities  in 
terms  that  can  be  tested.  The  user,  as  a 
member  of  the  IPT,  should  take  the  lead 
in  preparing  a  draft  ORD  with  broadly 
defined  system  characteristics  for  each 
alternative  under  consideration.  These 
draft  ORDs  will  greatly  aide  in  the  analy¬ 
sis  by  providing  a  basis  for  numerical  in¬ 
puts  for  MOEs,  MOSs,  and  MOPs  that  are 
used  in  the  analysis.  Step  one  has  the  fol¬ 
lowing  goals: 

•  Identify  the  performance  and  cost  ad¬ 


vantages  and  disadvantages  between 
proposed  systems  over  the  existing  sys¬ 
tem  and/or  a  modified  system. 

•  Broadly  define  the  system  characteris¬ 
tics  needed  in  the  new  system. 

•  Select  the  preferred  alternative  to  carry 
into  Phase  I  of  the  acquisition  cycle. 

Step  two.  The  IPT,  with  the  user  taking 
the  lead,  should  then  formalize  the  draft 
ORD  (see  step  one)  for  the  preferred  al¬ 
ternative.  In  paragraph  four  of  the  ORD, 
list  the  required  capabilities  as  operational 
performance  parameters.  The  format  for 
the  ORD  is  prescribed  in  Appendix  II  of 
DoD  REGULATION  5000.2-R.  Results 
from  the  analysis  of  alternatives  should 
be  used  to  better  define  those  system  char¬ 
acteristics  that  are  important  in  ensuring 
that  the  system  meets  the  user’s  needs.  The 
operational  performance  parameters  in 
paragraph  four  of  the  ORD  should  be 
stated  in  a  manner  that  facilitates  their 
translation  into  MOEs,  MOSs,  and  MOPs 
for  listing  in  the  TEMP.  Each  operational 
performance  parameter  should  be  readily 
identifiable  and  have  a  clearly  stated 
threshold  and  objective.  Examples  of  good 
and  bad  operational  performance  param¬ 
eters  follow: 

Good:  The  KILLER  must  have  a  prob¬ 
ability  of  kill  for  stationary  targets  that 
meets  or  exceeds  90%  in  the  range  band 
of  20-  to  250  m  during  day  operations  in 
all  types  of  weather  and  terrain.  The  de¬ 
sired  probability  of  kill  for  this  type  of 
target  is  95%. 

Bad:  The  KILLER  must  have  a  prob¬ 
ability  of  kill  for  moving  targets  that  meets 
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or  exceeds  that  of  the  legacy  system. 

Comments:  The  good  operational  per¬ 
formance  parameter  clearly  indicates  that 
the  test  parameter  is  probability  of  kill.  It 
clearly  states  the  threshold  and  objective. 
It  also  provides  an  adequate  amount  of  in¬ 
formation  to  establish  the  environment. 
The  bad  example  fails  to  clearly  state  the 
thresholds,  objectives,  and  environmental 
conditions. 

A  preliminary  choice  of  KPPs  should 
be  made  at  this  time.  They  will  be  formally 
approved  at  component  level  and  by  the 
JROC. 

Step  three.  Specify  the  COIs  and  the  CIIs. 
As  part  of  the  IPT  process,  the  user  and 
the  operational  tester  should  assume  the 
lead  in  the  specification  of  the  COIs  and 
CIIs.  The  COIs  should  address  the  top  sys¬ 
tem  level  mission  essential  tasks.  A  good 
source  for  the  identification  of  COIs  are 
paragraph  one  and  the  introductory  state¬ 
ments  for  paragraph  four  in  the  ORD.  For 
example,  the  ORD  states  that  a  helicopter 
will  conduct  armed  and  unarmed  recon¬ 
naissance  and  security  operations  in  com¬ 
bat.  An  appropriate  COI  that  addressed 
this  mission  essential  task  might  be:  “Can 
helicopter  A  conduct  armed  and  unarmed 
reconnaissance  and  security  operations  in 
combat?”  COIs  are  questions  that  when 
answered  support  a  determination  of  sys¬ 
tem  effectiveness  and  suitability.  The 
number  of  COIs  to  adequately  address 
effectiveness  and  suitability  normally 
range  from  3  to  10.  The  absolute  minimum 
is  2,  one  for  effectiveness  and  one  for  suit¬ 
ability. 

The  determining  factor  as  to  how  many 
COIs  are  needed  is  the  number  of  mission 
essential  tasks.  Carefully  specified  COIs 


have  the  potential  to  address  more  than 
one  mission  essential  tasks.  Each  COI  re¬ 
quires  a  sufficient  number  of  MOEs  or 
MOSs  to  adequately  determine  an  answer. 
An  excessive  number  of  COIs  tends  to  in¬ 
crease  the  total  number  of  test  data  ele¬ 
ments  that  must  be  collected  during  op¬ 
erational  testing  and  should  be  avoided 
whenever  possible.  The  CII  is  a  special 
type  of  COI  that  addresses  compatibility, 
interoperability,  or  integration  issues.  A 
good  source  for  the  specification  of  CIIs 
is  the  other  system  characteristics  listed 
in  paragraphs  5f  and  5h  in  the  ORD.  It  is 
possible  to  specify  one  COI  that  ad¬ 
equately  addresses  all  the  compatibility, 
interoperability,  and  integration  issues.  For 
example,  “Is  the  KILLER  compatible  and 
effectively  integrated  with  other  systems 
on  the  battlefield?  Note  that  this  is  a  stand- 
alonfe  system  and  has  no  interoperability 
issues.” 

Step  four.  As  identified  in  the  ORD, 
specify  system  specific  MOEs  and  MOSs 
and  supporting  MOPs  as  required.  List  the 
thresholds  and  objectives  for  these  opera¬ 
tional  performance  parameters  in  matrix 
format  (recommend  by  the  author  but  not 
mandated  by  DoD  REGULATION 
5000.2-R)  in  Part  I  of  the  TEMP.  The  ORD 
also  suggests  that  those  operational  per¬ 
formance  parameters  that  support  the  de¬ 
termination  of  other  parameters  be  desig¬ 
nated  to  be  MOPs.  A  numbering  scheme 
should  be  used  to  reflect  which  parameters 
are  MOEs  and  MOSs  and  which  param¬ 
eters  are  MOPs.  For  example,  MOP  1-2-3 
indicates  that  this  operational  performance 
parameter  is  MOP  3  and  that  it  supports  the 
determination  of  MOE  2  or  MOS  2  which 
supports  COI  1.  If  COI  1  is  an  effectiveness 
COI  then  MOE  2  is  appropriate. 


159 


Acquisition  Review  Quarteriy — Fali  1996 


COI 

MOE/MOST/MOP/CTP; 

(Parameter): 

Threshold/Objective 

Analysis  of 

Alternatives; 

Threshold/Objective 

APB  Parameter; 
Threshold/Objective 

CO1 1;  Kill  Enemy 
Armor? 

MCE  1-1  (Probability 
of  Kill;  .9/.95 

Probabilty  of  Kill: 
.9/.95 

Probability  of  Kill: 
.91.95 

MOE1-2 

(Survivability):  Yes  or  No 

Survivability 

MOP  1-1-1  (Probability 
of  Hit— Moving):  .5/.8 

Probability  of  Hit- 
Moving;  .5/.8 

Probability  of  Hit- 
Moving;  .5/.8 

MOP  1-1-2  (Probability 
of  Hit— Stationary):  .8/.9 

Probability  of  Hit- 
Stationary:  .8/.9 

Probability  of  Hit- 
Stationary:  .8/.9 

MOP  1-2-1 

(Soft  Launch);  Yes  or  No 

Soft-Launch 

Capability 

Soft  Launch 

Capability 

MOE1-3/CTP3 
(Weight):  20  lbs/16  lbs 

Weight: 

20  lbs/16  lbs 

Weight: 

20  lbs/1 6lbs 

COI  2-Supportable 

In  Combat? 

MOS  2-1  (Reliability) 

.9/.9 

Reliability;  .91.9 

Reliability;  .91.9 

MOS  2-2 
(Transportable); 

Yes  or  No 

Transportable; 

Yes  or  No 

MOS  2-3  (Maintenance 
Concept):  No 
Maintenance  Required 

Maintenance 

Concept 

Etc. 

Etc. 

Etc. 

Figure  6.  Consistency  (Harmonization-Linkage)  Matrix 


Step  five.  If  not  the  same  IPT,  this  IPT  ers  are  candidates  for  inclusion  as  a  per- 
should  provide  a  recommended  list  of  per-  formance  parameter  in  the  APB.  The 
formance  parameters  to  the  IPT  that  is  analysis  of  alternatives  should  be  an  ex¬ 
drafting  the  APB.  Those  parameters  cellentsourcedocumentfortheappropri- 
should  be  limited  to  those  parameters  des-  ate  IPT  to  use  to  identify  performance 
ignated  as  key  performance  parameters  in  parameters  that  are  cost  drivers.  For  ex- 
the  ORD.  The  MDA  has  the  latitude  to  add  ample,  miles  per  gallon  for  the  M 1 A2  tank 
other  performance  parameters  to  this  list.  is  cost  driver  for  life  cycle  costs  for  the 
Performance  parameters  that  are  cost  driv-  tank. 


160 


Specificafion,  Harmonizafion,  and  Linkage  of  Test  Parameters 


Step  six.  Specify  the  CTPs.  In  the  past 
CTPs  and  MAOPRs  (now  called  opera¬ 
tional  performance  parameters)  were  con¬ 
sidered  to  be  interchangeable.  But  CTPs 
should  be  considered  to  be  distinctly  dif¬ 
ferent  from  operational  performance  pa¬ 
rameters.  Operational  performance  param¬ 
eters  are  more  appropriately  tested  in  an 
operational  (uncontrolled)  environment; 
CTPs  are  more  appropriately  tested  in  a 
developmental  (controlled)  environment. 
As  part  of  the  IPT  process,  the  material 
developer  representatives  supported  by  the 
contractor  and  the  government  technical 
test  manager  should  take  the  lead  in  CTP 
specification.  White  the  ORD  is  specifi¬ 
cally  stated  to  be  a  source  for  CTPs,  they 
should  be  limited  to  system  level  perfor¬ 
mance  that  is  specified  in  the  contract. 
Technical  performance  measurements  are 
normally  used  by  the  contractor  and  the 
government  system  engineers  to  manage 
the  engineering  development  of  a  system. 
The  most  significant  system  level  techni¬ 
cal  performance  parameters  are  the  best 
candidates  for  selection  as  CTPs.  Not  all 
system  level  TPMs  should  be  designated 
to  be  CTPs — only  those  can  be  directly 
linked  to  supporting  a  mission-essential 
task  from  the  ORD.  For  example,  a  sys¬ 
tem-level  TPM  might  be  miles  per  gallon 
under  tightly  controlled  driving  condi¬ 
tions.  This  TPM  directly  supports  the 
achievement  of  a  mission-essential  task 
for  tank  mobility  without  refueling  for 
some  specified  distance.  Therefore  this 
TPM  is  an  appropriate  CTP.  Appendix  III 
of  DoD  REGULATION  5000.2-R  states 
that  CTPs  should  include  parameters  from 
the  APB.  I  recommend  that  this  guidance 
be  implemented  as  follows: 

Those  parameters  in  the  APB  that  are 
already  specified  to  be  operational  perfor¬ 


mance  parameters  (MOEs,  MOSs,  or 
MOPs)  from  the  ORD  need  not  be  speci¬ 
fied  as  CTPs  unless  those  operational  per¬ 
formance  parameters  are  also  contractu¬ 
ally  specified.  Those  APB  parameters  that 
are  not  operational  performance  param¬ 
eters  and  are  not  contractually  specified 
should  be  specified  to  be  an  operational 
performance  parameter  if  the  parameter 
is  most  appropriately  tested  in  an  opera¬ 
tional  environment  or  a  CTP  if  more  ap¬ 
propriately  tested  in  a  controlled  environ¬ 
ment.  In  either  case,  the  specified  CTP  or 
operational  performance  parameter  should 
be  annotated  to  reflect  that  the  source  for 
the  parameter  is  the  APB. 

Step  seven.  Prepare  a  “what  to  test”  pa¬ 
rameter  dendritic  that  shows  how  all  the 
test  parameters  are  related  to  each  other 
(Figure  7).  This  dendritic  is  useful  in 
checking  for  consistency  among  the  “what 
to  test”  parameters  and  is  useful  in  test 
planning  in  determining  what  test  data  el¬ 
ements  will  be  needed.  When  complete, 
all  MOEs  and  MOSs  must  be  linked  to  a 
COI.  If  not,  specify  a  COI  that  addresses 
the  top-level  issue  that  the  MOE  or  MOS 
addresses.  All  CTPs  should  be  linked  to  a 
MOE,  MOS,  and  in  some  cases  directly 
to  a  COI.  Note  that  the  dendritic  includes 
both  CTPs  and  operational  performance 
parameters.  Those  CTPs  that  are  not  op¬ 
erational  performance  parameters  should 
be  linked  to  COIs  and  MOEs,  MOSs,  and 
MOPs.  This  linkage  is  important  in  deter¬ 
mining  how  technical  performance  affects 
required  capabilities.  During  operational 
testing,  the  OTA  has  the  latitude  to  treat  a 
CTP  that  is  not  duplicated  by  an  opera¬ 
tional  performance  parameter  in  the  same 
manner  that  operational  performance  pa¬ 
rameters  are  treated.  The  primary  differ- 
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Figure  7.  Test  Parameter  Dendritic 


ence  is  that  the  environment  that  was  con¬ 
trolled  for  testing  CTPs  is  now  uncon¬ 
trolled.  The  OTA  is  not  limited  to  previ¬ 
ously  specified  thresholds  for  a  CTP.  Dur¬ 
ing  operational  testing,  the  CTP  is  simply 
a  criteria  to  be  used  in  the  evaluation  and 
determination  of  MOEs,  MOSs  and 
MOPs. 

Step  eight.  The  final  step  in  this  process 
is  to  ensure  that  consistency  (harmoniza¬ 
tion  and  linkage)  is  established  between 
the  “what  to  test”  parameters  among  the 
key  acquisition  documents  (TEMP,  ORD, 
APB)  and  the  measures  criteria  used  in  the 
analysis  of  alternatives. 

CONCLUSION 


This  article  has  discussed  the  latest 
DOD  5000  series  guidance  on  specifying 
“what  to  test”  parameters,  how  to  estab¬ 
lish  consistency  (harmony  and  linkage). 


and  has  outlined  an  eight  step  process  to 
implement  this  guidance. 

This  process  is  complicated  by  the 
complex  terminology  that  varies  within 
the  various  parts  of  the  DoD  5000  series. 
A  key  simplification  is  to  limit  CTPs  to 
contractually  specified  performance  that 
is  most  appropriately  tested  during  devel¬ 
opmental  testing.  The  operational  perfor¬ 
mance  parameters  from  the  ORD  are  listed 
in  the  TEMP  and  are  more  appropriately 
tested  in  an  operational  environment.  This 
type  of  specification  process  does  not  pro¬ 
hibit  the  test  manager  from  testing  some 
of  the  operational  performance  parameters 
during  developmental  testing  or  testing 
CTPs  during  testing  that  is  primarily  op¬ 
erational  in  nature.  In  fact,  a  wise  program 
manager  will  ensure  that  this  happens. 
However,  this  process  does  clearly  recog¬ 
nize  that  operational  performance  param¬ 
eters  are  designed  for  operational  testing 
while  critical  technical  parameters  are 
designed  for  developmental  testing. 
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IMPLEMENTING  INTEGRATED 
PRODUa  DEVELOPMENT: 

A  PROJEa  MANAGER'S 
PERSPECTIVE 


RUhard  IV.  Bregard  and  Taylor  Chasteen 


This  is  a  first-hand  account  of  an  actual  Integrated  Product  Team  imple¬ 
mentation  experience  from  the  project  manager’s  perspective.  Using  the  vision 
articulated  by  senior  leaders  in  the  Department  of  Defense  and  the  Army,  the 
manager  tailored  a  practical  approach  to  fit  the  development  effort. 
Implementing  an  integrated  product  development  (IPD)  approach  that  can 
return  significant  benefits  is  a  formidable  task,  over  and  above  the  serious 
technical  and  programmatic  challenges  facing  the  team.  The  authors  discuss 
the  historical  and  cultural  reasons  for  the  resistance  to  IPD  they  experienced. 
They  explore  the  types  of  teams  and  implementation  steps  in  terms  of  their 
value  added  to  the  end  product.  Finally,  the  authors  express  some  concerns 
about  the  future  of  IPD  and  its  role  in  changing  the  established  organizational 
culture. 


Officially  chartered  in  1979,  the  mis¬ 
sion  of  the  Office  of  the  Project 
Manager  for  Tank  Main  Armament 
Systems  is  to  manage  the  development  of 
Abrams  Tank  lethality  systems,  including 
armaments  and  ammunitions  systems. 
Over  the  past  17  years,  the  Project  Office 
has  been  extremely  successful  at  this  mis¬ 
sion.  One  current  ammunitions  program 
is  the  M829E3,  120mm  Kinetic  Energy 
Cartridge.  The  goal  is  to  develop  and  pro¬ 
duce  the  most  lethal  and  accurate  kinetic 
energy  round  the  world  has  ever  seen.  This 


is  proving  to  be  the  most  technically  chal¬ 
lenging  project  this  office  has  ever  at¬ 
tempted.  Moreover,  the  project  must  op¬ 
erate  in  an  environment  of  shorter  devel¬ 
opment  cycles  and  very  limited  funding. 
To  increase  the  chance  for  program  suc¬ 
cess,  the  office  determined  initially  that  it 
must  fundamentally  change  the  way  it 
manages  development.  While  the  more 
traditional  management  styles  have  been 
successful,  they  now  appear  too  costly  and 
time  consuming  to  survive  in  the  new  era 
of  military  and  product  modernization. 
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A  relatively  new  management  model. 
Integrated  Product  Development  (IPD), 
offers  substantial  benefits  that  would  help 
overcome  these  challenges.  Flatter  orga¬ 
nizations  and  more  teaming  are  central 
tenets  of  the  IPD  philosophy.  The  Depart¬ 
ment  of  Defense  (DoD)  has  tailored  the 
IPD  philosophy  by  instituting  the  Over¬ 
arching  Integrated  Product  Team  (OIPT) 
to  help  solve  problems  and  expedite  the 
decision  process  at  a  higher  level  of  de¬ 
fense  acquisition  management.  Mean¬ 
while,  senior  DoD  and  Army  leadership 
charges  the  project  manager  (PM)  with  re¬ 
sponsibility  to  foster  the  Integrated  Prod¬ 
uct  Team  (IPT)  at  the  working  level. 

IPD  integrates  all  relevant  skill  sets 
early  in  a  product’s  life  cycle  and  pushes 
critical  decision  making  authority  down 
to  the  lowest  possible  level.  Early  integra¬ 
tion  of  skill  sets  increases  the  probability 
that  issues  are  raised  and  solved  early  in 
the  life  cycle.  Streamlined  decision  mak¬ 
ing  decreases  development  time,  reduces 
personnel  costs,  and  improves  integration 
of  the  total  product.  However,  correctly 
implementing  the  IPD  philosophy  can  be 
difficult.  In  this  case,  it  required  a  funda¬ 
mental  cultural  change  throughout  govern¬ 
ment  and  private  contractor  organizations 
that  had  successfully  managed  120mm 
tank  cartridge  development  for  decades. 
This  paper  describes  our  recent  IPD  imple¬ 
mentation  experience  in  the  Office  of  the 


Project  Manager,  Tank  Main  Armament 
Systems. 

Context 


Project  management  in  today’s  Army 
requires  the  PM  to  solicit  and  employ  ex¬ 
pertise  from  various  government  organi¬ 
zations  and  contractors.  During  the  previ¬ 
ous  era  of  ammunition  development,  de¬ 
velopmental  government  organizations 
became  characterized  as  too  hierarchical, 
with  engineers  and  scientists  working  at 
the  lower  levels,  engineering  management 
above  them,  and  business  management  on 
top.  Generous  project  money  helped  sup¬ 
port  this  management  structure.  Past  fund¬ 
ing  levels  also  supported  independent,  and 
sometimes  simultaneous,  development 
programs  having  several  contractors 
whose  hierarchical  management  stractures 
reflected  those  in  the  government  organi¬ 
zations  they  were  supporting. 

Though  top  heavy  and  sometimes  pon¬ 
derous,  120mm  tank  munitions  develop¬ 
ment  was  very  successful.  Problems  were 
solved  by  focusing  on  the  product  and 
schedule  at  the  expense  of  cost.  Cost  was 
not  an  independent  variable.  Successful 
programs  and  a  tradition  of  adequate  fund¬ 
ing  created  a  natural  bureaucratic  inertia 
in  the  organizations  that  develop  tank 
munitions.  When  these  efforts  began,  gov- 
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ernment  and  contracting  organizations 
were  resisting  significant  process  changes 
despite  the  funding  pressures  experienced 
over  the  last  few  years.  Recently,  changes 
in  organizational  thinking  have  taken 
place. 

Contrasting  IPD  With  Tradition _ 

In  the  generic  and  more  traditional 
project  management  model,  the  project 
office  manages  funding,  development, 
product  integration,  transition  from  R&D 
to  production,  and  fielding.  However,  due 
to  limited  staff,  independent  technical  or¬ 
ganizations  such  as  design  engineering, 
testing,  and  procurement  often  provide 
matrix  support  to  the  PM.  Unfortunately, 
along  with  the  technical  expertise  comes 
layered  functional  management.  Decision 
making  is  slowed  by  time-consuming 
meetings,  briefings,  and  staffing  require¬ 
ments. 

Complicating  matters  further,  each 
functional  organization,  working  on  its 
piece  part,  vies  for  resources  provided  by 
the  project  office.  The  competition  is 
good,  but  at  a  micro  level,  the  result  is 
often  over-  and  under-funding  of  the  dif¬ 
fering  technical  areas.  Under-funded  ar¬ 
eas  naturally  cause  project  delay.  Rede¬ 
sign,  which  is  costly  and  generally  re¬ 
served  to  solve  integration  problems,  in¬ 
creases  program  time  and  money  require¬ 
ments.  Thus,  the  decision  making  process 
is  further  aggravated  by  management 
“stovepipes”  and  inefficient  communica¬ 
tion. 

On  the  private  contractor  side,  busi¬ 
nesses  tend  to  closely  mirror  the  organi¬ 
zational  structure  and  culture  of  their 
counterpart  government  customers.  Again, 


generous  project  money  supported  this 
approach.  Many  of  the  same  problems 
associated  with  powerful  functional  orga¬ 
nizations  and  layered  management  also 
exist  with  the  contractors.  Some  private 
companies  have  embraced  acquisition 
streamlining  and  IPD  on  their  own.  Oth¬ 
ers  resist  change  and  are  waiting  for  their 
government  customers  to  take  the  lead. 
Clearly,  there  are  significant  efficiencies 
yet  to  be  realized  from  both  the  govern¬ 
ment  and  contractors. 

In  contrast  to  the  more  traditional  ap¬ 
proach,  IPD  is  the  integration  of  all  needed 
skills  (program  management,  technical 
development,  producibility,  etc.)  early  in 
the  product’s  life  cycle.  In  the  language 
of  IPD,  the  team,  the  (EPT)  implements 
the  IPD  philosophy.  The  core  IPT  has 
overall  responsibility  for  managing  both 
the  programmatic  and  technical  decisions 
and  looks  for  means  to  integrate  the  prod¬ 
uct  (i.e.,  tries  to  understand  the  mutual 
impacts  of  the  product’s  various  piece 
parts)  early  in  the  life  cycle.  The  team 
leader  and  members  are  empowered  by 
their  respective  organizations.  Indeed, 
most  decisions  can  be  made  within  the 
context  of  the  team.  Consequently,  many 
of  the  briefings,  meetings,  and  staffing 
requirements  are  reduced  if  not  eliminated. 

Moreover,  with  the  team  making  re¬ 
source  allocation  decisions  in  one  “stove¬ 
pipe,”  thereby  subordinating  functional  in¬ 
terests  to  the  goals  of  the  team,  program 
management  is  optimized  to  avoid  sched¬ 
ule  and  overall  product  performance  im¬ 
pacts.  Equally  important  is  the  fact  that 
more  informed  decisions  can  be  made  on 
the  most  important  cost  drivers  early, 
when  most  of  the  program  cost  is  deter¬ 
mined.  Agreed-upon  team  goals  and 
metrics  create  pressure  to  manage  within 
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budget  and  schedule.  Ultimately,  rapid 
communication,  team  empowerment,  in¬ 
tegration  of  all  relevant  skill  sets,  and  team 
synergy  result  in  a  shorter  decision  cycle 
and  lower  development  costs. 

IPD  Implementation 


Transition  to  IPD  is  made  possible  by 
a  commitment  to  acquisition  reform  by 
senior  leadership  in  DoD,  DA,  PEO,  Ar¬ 
mored  Systems  Modernization  and  the 
Army  Materiel  Command.  Senior  man¬ 
agement  support  is  critical  to  IPD  due  to 
organizational  inertia  and  general  resis¬ 
tance  to  change.  Similarly,  IPD  is  critical 
to  acquisition  reform  in  the  sense  that  it 
allows  us  to  do  more  with  less,  brings  the 
acquisition  community  (public  and  pri¬ 
vate)  closer  together,  both  horizontally  and 
vertically,  and  facilitates  better,  faster, 
more  effective  communications.  Clearly 
the  timing  is  right  to  shift  to  this  new  de¬ 
velopment  philosophy. 

Ideally,  integrated  product  development 
teams  form  before  development  projects 
are  transitioned  to  a  project  office.  In  ac¬ 
tuality,  this  is  rarely  the  case.  When  it  was 
decided  to  manage  the  M829E3  program 
using  the  IPD  approach,  advanced  devel¬ 
opment  work  had  been  ongoing  for  a 
couple  of  years.  Fortunately,  the  office 
maintains  a  relatively  seamless  relation¬ 
ship  with  the  organizations  that  provide 
most  technical  expertise,  the  Army  Re¬ 
search  Laboratories  and  the  U.S.  Army  Ar¬ 
maments  Research,  Development  and 
Engineering  Center.  This  close  working 
relationship  mitigated  the  reality  that  the 
formal  team  structure  was  not  in  place  as 
early  as  desired.  Also,  since  the  program 
is  in  the  early  technology  demonstration 


phase,  using  an  IPD  approach  will  still 
have  a  significant  beneficial  impact. 

What  Type  of  Team  Should  Be  Used? 

There  are  many  types  of  teams  includ¬ 
ing  integrated  product  development  teams, 
concurrent  engineering  teams,  integrated 
concept  teams,  and  process  action  teams 
that  may  be  chartered  to  deliver  products, 
concepts,  or  processes.  Teams  are  char¬ 
tered  for  various  lengths  of  time,  perhaps 
to  encompass  an  entire  product  life  cycle 
or  to  address  a  specific  process  or  task, 
and  then  disbanded.  It  is  very  important 
to  understand  how  to  differentiate  types 
of  teams,  because  of  a  tendency  to  paste 
the  IPD  label  on  “business  as  usual,”  and 
the  concern  that  the  wrong  type  of  team 
would  be  established  for  the  M829E3  de¬ 
velopment. 

To  address  this  organizational  need  for 
a  better  understanding  of  teams,  this  of¬ 
fice  conducted  a  serious  review  of  the 
range  of  optional  team  structures  and 
implementation  strategies.  Specifically 
studied  were  lessons  learned  and  guides 
from  the  private  sector.  Department  of  De¬ 
fense,  Army  Materiel  Command,  and  the 
U.S.  Air  Force.  Particularly  interesting  is 
the  work  of  Steven  Wheelwright  and  Kim 
Clark.  In  their  book  Revolutionizing  Prod¬ 
uct  Development:  Quantum  Leaps  in 
Speed,  Efficiency,  and  Quality,  they  de¬ 
fine  a  spectmm  of  teams  classified  as  light¬ 
weight,  heavyweight,  and  autonomous. 
The  spectrum  is  largely  differentiated  by 
the  strength  of  the  team  leader  and  the 
amount  of  empowerment  the  team  is 
given,  starting  from  the  least  empowered 
lightweight  to  the  most  empowered  au¬ 
tonomous  team. 
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Figure  1.  Lightweight  Team  Structure 


The  lightweight  team  structure,  de¬ 
picted  in  Figure  1,  is  distinguished  by  a 
team  leader  who  is  usually  a  middle  or 
junior  person  in  the  parent  organization. 
He  is  more  of  a  coordinator  than  a  leader. 
Additionally,  the  lightweight  team  leader 
does  not  control  critical  resources.  Team 
members  remain  physically  located  with 
their  functional  organizations.  Rather  than 
focusing  primarily  on  the  work  of  the 
team,  team  members  look  to  their  func¬ 
tional  organizations  for  daily  support, 
guidance,  and  priorities.  Responsibility  for 
team  member’s  evaluations,  training,  and 
support  resides  solely  with  the  functional 
organization.  The  lightweight  team  is,  in 
effect,  a  reflection  of  the  way  our  prod¬ 
ucts  have  traditionally  been  managed. 

The  heavyweight  team  structure,  shown 
in  Figure  2,  has  a  strong  team  leader  with 
collocated  core  team  members.  The  leader 


is  directly  responsible  to  senior  manage¬ 
ment  for  all  the  work  done  by  the  team. 
Core  team  members  are  collocated  with 
the  team  leader.  The  team  leader  has  a  di¬ 
rect  influence  on  the  performance  apprais¬ 
als  of  team  members  and  indirectly  influ¬ 
ences  extended  team  members  through  his 
influence  over  the  core  team.  The  team  is 
empowered  to  make  decisions  in  a  stream¬ 
lined  environment,  eliminating  the  need 
to  get  functional  management  approval. 
The  team  has  control  over  key  resources, 
and  the  team  leader  has  influence  across 
organizations.  While  it  is  a  significant 
departure  from  the  traditional  develop¬ 
ment  model  described  earlier,  the  heavy¬ 
weight  structure  occupies  the  middle  part 
of  the  team  spectrum. 

Finally,  the  autonomous  team  stmcture, 
depicted  in  Figure  3,  is  distinguished  by  a 
strong  team  leader,  little  communication 
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Figure  2.  Heuvyweight  Team  Structure 


with  upper  management,  and  a  great  deal 
of  empowerment.  Sometimes  referred  to 
as  a  “tiger  team,”  the  autonomous  team 
members  are  full  time,  dedicated,  and  col¬ 
located  with  the  team  leader.  They  have 
full  control  over  resources,  practices,  and 
procedures.  Likewise  the  team  has  full 
responsibility  for  success  or  failure  of  the 
project.  This  type  of  team  is  most  appro¬ 
priate  for  a  new  product  development  re¬ 
quiring  an  unusually  rapid  development 
cycle.  Of  course,  with  so  much  delegation 
of  power,  this  type  of  team  often  makes 
senior  management  nervous. 

In  his  book  Managing  in  a  Time  of 


Great  Change,  Peter  F.  Drucker  also  dis¬ 
cusses  three  types  of  teams.  Drucker  ap¬ 
proaches  the  team  issue  from  both  a  struc¬ 
tural  and  humanistic  perspective.  He  uses 
the  analogy  of  a  baseball  team,  a  football 
team,  and  a  tennis  doubles  team.  In 
Drucker’s  view,  baseball  is  much  like  an 
assembly  line.  The  process  is  stable.  Ev¬ 
eryone  has  a  Job  and  if  you  mess  up,  usu¬ 
ally  there  is  no  one  who  can  help.  Al¬ 
though  aficionados  may  disagree,  Drucker 
says,  “[B]ase-ball  players  play  on  a  team; 
they  do  not  play  as  a  team.”  In  contrast, 
football  is  more  flexible  and  fluid.  There 
are  usually  opportunities  to  do  more  than 
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Source:  Revolutionizing  Product  Development:  Quantum  Leaps  in  Speed,  Efficiency,  and  Quality  by  Steven 
C.  Wheelwright  and  Kim  B.  Clark.  Copyright  ©  1992  by  Steven  C.  Wheelwright  and  Kim  B.  Clark.  Reprinted 
with  permission  of  The  Free  Press,  a  division  of  Simon  &  Schuster. 

Figure  3.  Autenemeus  Team  Structure 


your  specific  assignment  on  a  given  play. 
Therefore,  football  players  must  play  as 
a  team  to  be  successful.  Finally,  the  ten¬ 
nis  doubles  team  requires  still  more  syn¬ 
ergism  than  the  previous  two  examples. 
Both  players  must  be  in  total  sync  to  win. 
In  Drucker’s  example,  the  Japanese  cre¬ 
ate  this  kind  of  synchronization  by  using 
design  teams  that  incorporate  the  various 
relevant  disciplines  working  in  parallel.  As 
in  football  and  tennis  doubles,  each  mem¬ 
ber  must  subordinate  themselves  to  the 
team  to  be  successful. 

The  lightweight  team,  with  a  weak  team 
leader  having  little  influence  over  team 
members  and  few  incentives  to  create 
team  synergy,  did  not  seem  to  offer  a  cred¬ 
ible  chance  to  provide  the  real  benefits  this 
office  wanted  to  achieve.  Likewise,  the  au¬ 
tonomous  team,  with  its  considerable  em¬ 
powerment  and  associated  high  risk,  was 


not  appropriate  for  the  M829E3  develop¬ 
ment.  In  extreme  cases,  such  as  war  or 
serious  immediate  threat  to  our  national 
security,  the  autonomous  team  may  indeed 
be  preferable.  Instead,  a  composite  of  the 
heavyweight  or  football  type  team  was 
chosen  because  it  represented  the  great¬ 
est  possibility  for  efficiency  and  syner¬ 
gism,  given  a  long-term  developmental 
program  in  its  early  stages. 

Specifically,  a  robust  heavyweight  team 
could  be  tailored  by  incorporating  all  rel¬ 
evant  disciplines  for  tank  ammunition  de¬ 
velopment  and  capable  of  managing  the 
entire  life  cycle.  Core  team  members  could 
be  collocated  to  the  maximum  extent,  the 
team  could  be  empowered  to  make  deci¬ 
sions  in  a  streamlined  environment.  Yet, 
the  team’s  freedom  would  be  bounded  by 
the  legitimate  authority  reserved  by  the 
project  manager  and  codified  in  the  team’s 
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documentation.  The  heavyweight  team 
would  be  able  to  “push  the  envelope”  in 
terms  of  faster  communication  and  deci¬ 
sions,  without  going  to  extremes  in  terms 
of  empowerment  and  associated  risk.  This 
type  of  team  seemed  to  be  a  proper  bal¬ 
ance  of  risk  and  reward  for  a  full-scale  de¬ 
velopment  program. 

IMPIEMENTATION— Ex  POST  FACTO _ 

After  the  team  was  chosen,  an  imple¬ 
mentation  strategy  was  designed  that  of¬ 
fered  the  best  chance  for  success.  It  was  a 
very  methodical  approach  consisting  of 
four  discrete  steps  in  hopes  it  would  help 
avoid  major  problems.  In  order,  the  imple¬ 
mentation  steps  were  readiness  assess¬ 
ment,  senior  management  training,  facili¬ 
tator  training,  and  team  launch. 

The  process  of  putting  the  team  in  place 
would  take  five  months  (six,  counting  the 
government  furlough  of  November  1995). 
That  seemed  reasonable,  since  success¬ 
fully  negotiating  the  hurdles  of  change  re¬ 
quires  a  great  deal  of  brainstorming  and 
thought.  Namely,  for  the  first  time  since 
the  office’s  charter  was  enacted,  it  was  em¬ 
powering  a  heavyweight  integrated  devel¬ 
opment  team  to  manage  a  program.  This 
was  in  fact  significantly  changing  the  or¬ 
ganizational  culture  of  the  tank  ammuni¬ 
tion  business.  Meanwhile,  the  office  was 
managing  a  technically  challenging  effort, 
which  was  moving  at  a  rapid  pace,  and 
was  underfunded.  The  challenge  was 
huge — so  were  the  rewards. 

Readiness  Assessment 


A  readiness  assessment  was  critical  to 
IPD  implementation.  Its  purpose  was  to 


assess  the  potential  organizational  and 
cultural  barriers  to  the  successful  IPD  ef¬ 
fort.  From  top  to  bottom  and  across  the 
organizations  providing  human  resources 
to  the  team,  relevant  persons  were  asked 
to  fill  out  a  questionnaire  concerning  how 
ready  the  organization(s)  were  to  accom¬ 
modate  IPD.  The  questionnaire  addressed 
ten  areas,  including  customer  focus,  se¬ 
nior  management  support,  agility,  etc.  Re¬ 
spondents  were  asked  if  they  thought  team 
members  understood  customer  require¬ 
ments,  whether  there  was  sufficient  senior 
management  support,  and  if  team  mem¬ 
bers  were  committed  to  IPD.  The  re¬ 
sponses  to  the  questionnaires  were  used 
in  follow-up  interviews  to  amplify  the  re¬ 
sponses.  The  data  was  compiled,  orga¬ 
nized,  and  quantified. 

The  value  of  the  assessment  was  three¬ 
fold.  First,  the  large  body  of  responses 
identified  the  problem  areas  more  reliably. 
Second,  anecdotal  information  was  turned 
into  quantifiable  assessments  that  could 
readily  be  used  to  identify  organizational 
barriers  to  IPD.  Third,  the  assessment  pro¬ 
cess  was  viewed  as  objective  information 
gathering.  This  tended  to  take  parochial 
politics  out  of  the  process  to  a  great  ex¬ 
tent  and  provided  a  more  solid  foundation 
for  the  steps  that  followed. 

To  address  the  potential  barriers  iden¬ 
tified  in  the  readiness  assessment,  the  of¬ 
fice  needed  a  vehicle  in  which  to  codify 
an  organizational  framework  across  sev¬ 
eral  organizations.  (These  organizations 
included  the  Office  of  the  Project  Man¬ 
ager  for  Tank  Main  Armament  Systems, 
Abrams  Project  Office,  Army  Research 
Laboratories  and  the  U.S.  Army  Research 
Development  and  Engineering  Center. 
The  Ordnance  Support  Contractors,  OLIN 
Corp  and  Alliant  Techsystems  were  also 
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involved  on  an  ad  hoc  basis.)  Hence,  a 
Memorandum  of  Agreement  (MO  A)  was 
drafted  around  the  heavyweight  team 
structure,  incorporating  solutions  to  the 
concerns  identified  by  the  readiness  as¬ 
sessment.  Importantly,  the  MOA  included 
the  extent  and  limitations  of  authority  pro¬ 
vided  to  the  IPT.  There  were  also  specific 
mandates  to  the  IPT,  such  as  a  requirement 
to  develop  process  plans  like  communi¬ 
cation,  decision  making,  and  administra¬ 
tion.  Finally,  the  MOA  included  clauses 
that  would  foster  team  development,  ad¬ 
dressing  issues  like  collocation,  perfor¬ 
mance  appraisals,  and  team  awards. 

Senior  Leader  Training 


Senior  leadership  training  came  next. 
Many  IPT  implementation  plans  eliminate 
this  step.  Typically,  new  worthy  concepts 
gain  favor  and  people  assume  that  senior 
management  has  a  thorough  understand¬ 
ing  of  the  concept  and  associated  issues. 
That  is  a  false  assumption.  Also,  leader¬ 
ship  must  sometimes  un-leam  false  no¬ 
tions  derived  from  incomplete  knowledge 
and  years  of  managing  the  old  way.  Many 
times  the  results  of  not  training  senior 
management  are  lack  of  support,  misap¬ 
plication  of  concepts  and  failed  efforts. 
This  office  set  out  to  avoid  this  trap. 

IPD  senior  management  training  was 
combined  with  a  full  discussion  of  the 
MOA  in  a  two-day  meeting.  Dr.  Jack  Byrd 
of  the  Center  for  Entrepreneurial  Studies 
and  Development,  Inc.  (CESD,  Inc.),  a 
leader  in  the  field  of  IPD,  facilitated  the 
meeting.  Attendees  included  senior  execu¬ 
tives  and  upper  management  from  the  four 
major  governmental  organizations  provid¬ 
ing  human  resources  to  the  M829E3  ef¬ 


fort.  Senior  managers  from  the  potential 
systems  contractors  were  also  included  in 
the  two-day  meeting  as  ad  hoc  members 
and  potential  signatories  to  the  MOA. 

Senior  leader  training  was  very  suc¬ 
cessful.  Discussions  of  the  M829E3  pro¬ 
gram  and  IPD  philosophy  led  to  a  specific 
agreement  to  embrace  IPD.  Armed  with  a 
laptop  computer,  the  meeting  recorder 
made  real-time  changes  to  the  MOA  as 
discussions  progressed.  By  the  end  of  the 
second  day,  the  leaders  of  the  four  major 
organizations  signed  the  MOA.  This  event 
marked  the  end  of  the  first  phase  of  imple¬ 
mentation  and  was  a  major  step  in  gener¬ 
ating  cultural  change.  The  significance  of 
a  signed  MOA  demonstrated  the  highest 
level  of  commitment  of  the  organizations 
involved.  Moreover,  these  leaders  gave  the 
IPT  the  freedom  of  action  it  would  need 
to  return  real  benefits. 


Facilitator  Training 


The  facilitator  of  the  senior  manage¬ 
ment  training  is  essential  to  achieving  the 
stated  goals  for  the  meeting.  Good  facili¬ 
tators  plan  a  meeting.  In  conjunction  with 
the  team  leader  and  subject  matter  experts, 
the  facilitator  lays  out  the  agenda,  goals, 
time  limits,  and  ground  rales  ahead  of  the 
meeting.  The  facilitator  then  manages  the 
dialogue  using  various  facilitation  tech¬ 
niques  and  focusing  the  group  on  the  goals 
of  the  meeting.  The  facilitator  gets  every¬ 
one  involved  and  promotes  meeting  own¬ 
ership.  Trained  facilitators  are  key  to  maxi¬ 
mizing  the  time  spent  in  meetings. 

Candidates  for  facilitator  training  were 
chosen  for  their  personality,  expertise,  and 
mental  agility.  In  addition  to  training 
members  of  the  team,  the  office  also 
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trained  facilitators  who  were  not  part  of 
the  team  and  who  could  be  used  as  inde¬ 
pendent  resources.  Facilitator  training  was 
timed  to  coincide  with  team  launch,  thus 
allowing  the  trained  facilitators  to  apply 
their  newly  acquired  skills.  This  training 
approach  incorporated  current  product 
and  process  issues  facing  the  IPT.  Hence, 
trainees  accomplished  real  work  instead 
of  exercising  with  case  studies  and  hy¬ 
pothetical  examples.  This  approach  was  a 
constant  theme  throughout  implementation. 

Team  Launch 


The  final  phase  of  implementation  was 
team  launch.  The  purpose  of  this  phase 
was  to  carry  out  the  mandates  embedded 
in  the  MO  A.  The  launch  was  the  most  dif¬ 
ficult,  and  some  said  the  most  critical, 
stage  of  IPD  implementation.  It  is  during 
the  launch  process  that  the  reality  of  cul¬ 
tural  change  becomes  apparent.  As  spe¬ 
cifics  are  discussed  and  decisions  made, 
the  extent  to  which  old  lines  of  authority 
are  being  severed  and  new  ways  of 
operatingput  into  place  becomes  clear.  The 
increased  responsibility  is  felt  by  team 
members  and  the  old  hierarchical  system 
reacts  nervously. 

To  implement  the  launch,  team  mem¬ 
bers  focused  on  process  issues.  Members 
developed  team  norms  and  decision  mak¬ 
ing  plans,  along  with  a  host  of  other  pro¬ 
cess  plans.  Since  this  was  a  labor-inten¬ 
sive  effort  that  required  time  and  depth  of 
consideration,  the  launch  activities  were 
split  into  two  parts.  First,  a  two-day  ses¬ 
sion  attended  by  the  core  team  (about  eight 
persons)  was  held  to  develop  “strawman” 
plans.  An  interim  period  of  three  weeks 
passed  to  allow  for  discussion  and  thought 


before  the  ‘strawmen’  were  presented  to 
the  whole  team.  Changes  were  made  to 
the  strawmen  and  the  plans  were  placed 
into  a  team  contract  book.  The  contract 
book  is  a  collection  of  governing  docu¬ 
ments  for  the  team,  such  as  the  team 
leader’s  charter,  MOA,  and  all  the  process 
plans  developed  through  the  launch  pro¬ 
cess.  The  plans  are  considered  draft;  the 
team  can  always  change  them.  On  the  last 
day  of  team  launch,  the  team  leader  was 
presented  with  a  written  charter  that  de¬ 
lineated  his  responsibilities  as  the  leader 
of  the  IPT.  This  event  signified  the  end  of 
the  implementation  process. 

The  implementation  plan  required  a 
great  deal  of  hard  work  that  was  accom¬ 
plished  without  halting  the  technically 
challenging  program.  Big  challenges  lie 
ahead.  The  team  is  expected  to  return  im¬ 
mediate  benefit.  For  example,  the  Qual¬ 
ity  Functional  Deployment  (QFD)  model 
with  a  common  dictionary  ensures  that 
user  requirements  and  trade  off  decisions 
are  understood.  The  uncertainty  risk  re¬ 
duction  tool  provides  a  formal  process  to 
manage  risk  over  the  life  of  the  develop¬ 
ment.  The  decision  making  process  com¬ 
pliments  the  empowerment  given  to  the 
team  in  the  MOA.  As  the  team  matures 
and  goes  through  team  development 
phases  over  time,  it  will  develop  confi¬ 
dence  and  operate  more  efficiently  as  team 
members  and  functional  managers  be¬ 
come  comfortable  within  this  new  orga¬ 
nizational  framework.  In  due  time,  the 
team  owes  management  an  objective  evalu¬ 
ation  of  its  effectiveness.  Team  metrics  and 
goals,  developed  during  the  launch  process, 
will  be  evaluated  and  the  real  successes  and 
disappointments  weighed. 


172 


Implementing  Integrated  Product  Development 


Issues  And  Conclusion 


There  are  still  many  issues  to  be  ad¬ 
dressed  with  regard  to  Integrated  Product 
Development.  After  years  of  creating  large 
and  powerful  functional  organizations,  we 
must  clarify  the  role  of  the  functional  or¬ 
ganization  and  indeed  the  respective  man¬ 
agement  stmcture.  We  have  created  career 
tracks  for  employees  that  use  the  hierar¬ 
chical  functional  organization  as  the  cen¬ 
terpiece  of  career  aspirations.  What  is  the 
logical  career  track  for  IPT  members? 
How  do  we  accommodate  team  members 
who  have  been  collocated  with  a  team  for 
three  years  and  return  to  their  functional 
organization?  These  issues  transcend  any 
one  organization.  They  go  to  the  heart  of 
the  way  we  manage  civilian  personnel  in 
the  government  and  the  future  of  IPD  in 
this  business. 

IPD  is  still  viewed  as  a  serious  threat 
by  some  in  the  public  and  private  sectors. 
Failure  to  deal  adequately  with  these  is¬ 
sues  could  easily  lead  to  pasting  IPD  la¬ 
bels  on  programs  without  making  real 
changes  in  the  way  they  are  managed.  The 
workforce  is  watching  how  team  members 
are  treated.  We  must  address  their  needs 
and  their  career  aspirations.  Failure  to  do 
so  will  deliver  a  hard  blow  to  IPD.  Suc¬ 
cessfully  addressing  issues  such  as  these 


will  be  the  final  blow  to  an  outdated  and 
costly  way  of  doing  business. 

Cultural  change  takes  years  to  accom¬ 
plish.  The  momentum  for  IPD  is  strong 
now,  but  we  must  be  vigilant  to  make  it 
last.  The  automotive  industry,  for  example, 
was  traditionally  very  bureaucratic  and 
slow  to  market_that  is,  until  foreign  com¬ 
petition  brought  incredible  pressure  on  the 
players  to  make  real  changes  to  their  or¬ 
ganizational  culture.  Yet,  some  would  ar¬ 
gue  that  the  automotive  industry  is  still 
going  through  cultural  change  after  15+ 
years.  We  are  not  so  different.  Therefore, 
we  must  be  prepared  to  accept  the  risks 
and  continually  push  for  this  new  man¬ 
agement  paradigm. 

The  real  proof  of  IPD  lies  in  the  prod¬ 
uct  we  deliver  to  the  soldiers.  If  IPD  does 
not  provide  them  with  the  best  equipment 
available,  in  a  timely  and  cost-effective 
manner,  then  we  have  not  implemented  it 
correctly.  IPD  is  clearly  the  wave  of  the 
future  in  the  private  sector.  There  is  a  large 
body  of  evidence  that  supports  this  state¬ 
ment.  Saturn  develops  new  cars  in  18 
months.  From  first  concept  to  flying  pro¬ 
duction  models,  Boeing  develops  airlin¬ 
ers  in  less  than  six  years.  We  should  be 
able  to  match  this  kind  of  performance  in 
the  defense  acquisition  system.  IPD  is  our 
best  opportunity  to  achieve  this  goal. 
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TUTORIAL 


BLINDING  SPEED  EQUALS 
COMPETITIVE  ADVANTAGE 

G,  Dean  Clubb 


Texas  Instruments  Defense  Systems  &  Electronics  Group  has  actions  under¬ 
way  to  achieve  a  precipitous  reduction  in  the  time  now  required  to  design, 
develop,  and  manufacture  products  that  meet  customer  needs.  The  customer's 
No.  1  priority  is  to  receive  a  quality  product  at  the  lowest  price.  So  why  is 
Defense  Systems  and  Electronics  Group  focusing  on  cycle  time?  One  might 
ask,  “How  does  Tl’s  vision  of  reducing  cycle  time  meet  the  customer’s  need 
for  a  high  quality,  low-cost  product?”  The  answer  reminds  us  of  the  geometry 
lesson,  “The  shortest  distance  and  most  efficient  path  between  two  points  is  a 
straight  line." 


MM ycle  Time!”  What  does  this 
mean?  As  the  pace  of  the 
world  quickens,  the  value  of 
being  first  to  market  with  innovative  so¬ 
lutions  is  the  key  to  true  competitive  ad¬ 
vantage.  This  is  true  in  the  commercial 
marketplace  and  it  is  also  true  in  the  mili¬ 
tary  market. 

Consider  the  lessons  of  Desert  Storm. 
Texas  Instruments  (TI)  was  fortunate 
enough  to  participate  in  the  GBU-28  Bun¬ 
ker  Buster  Program.  A  new  system  was 
needed  to  deal  with  deeply  buried  com¬ 
mand  and  control  bunkers  that  were  be¬ 
yond  the  reach  of  existing  systems.  The 
need  was  great,  the  time  was  short,  and 
the  only  solution  was  to  innovate  a  solu¬ 
tion  in  an  unprecedented  short  period  of 
time.  A  team  of  government  and  industry 
people  came  together  sharing  the  common 


objective  of  solving  a  difficult  technical 
challenge  in  a  breakneck  race  against  time. 
Personal  interests  were  set  aside  as  were 
traditional  approaches,  with  long  hours 
being  the  norm.  The  team  worked  to  trade 
time  against  everything  (cost,  risk,  perfor¬ 
mance).  Reuse  of  existing  subsystems  of¬ 
fered  the  only  answer.  However,  the  pieces 
would  have  to  be  integrated  in  a  very  inno¬ 
vative  way  to  achieve  the  desired  results. 

The  result  was  the  GBU-28  Bunker 
Buster  that  was  conceived,  developed, 
tested,  and  deployed  in  approximately  28 
days.  This  was  less  time  than  had  ever 
been  dreamed  possible.  The  mission  was 
accomplished  and  the  GBU-28  played  a 
significant  role  in  the  ending  of  the  war.  It 
was  certainly  not  the  only  factor,  but  the 
fact  that  Iraq  surrendered  one  day  after  the 
system  destroyed  a  deep  command  bun- 
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Figure  1.  "Cycle  Time" 


ker  was  probably  not  a  coincidence.  The  clous  commodity  and  has  value — it  is  true 

entire  effort  made  a  difference  and  the  rea-  every  time  a  new  product  arrives  well  in 

son  was  time — blinding  fast  cycle  time.  advance  of  the  competition. 

The  system  performed  when  it  was  needed  Wasted  motion  is  expensive,  compro- 
but  there  were  also  other  benefits:  the  cost  mises  quality,  and  results  in  noncompeti- 

was  low  because  the  entire  effort  was  ac-  tive  products  and  services.  The  result  is 

complished  in  such  a  short  period.  Also,  that  instead  of  giving  the  customer  a  com- 

the  quality  and  reliability  was  high  be-  petitive  advantage,  the  wasted  motion  ac- 

cause  it  was  made  of  existing  proven  sub-  tually  results  in  customer  dissatisfaction, 

assemblies.  A  common  thread  emerges  Achieving  customer  satisfaction  will  dic- 

when  this  experience  is  compared  with  tate  company  survival.  The  companies  that 

other  similar  ones:  If  you  can  drive  down  meet  their  customers’  needs  of  low  cost 

cycle  time,  cost  and  quality  will  improve.  and  high  quality  will  be  the  companies  that 

So  the  bottom  line  is  that  time  is  a  pre-  maintain  prominence.  Cycle  time,  speed. 


Dean  Clubb  is  President  of  the  Defense  Systems  Electronics  Group,  and  corporate  Executive 
Vice-President  of  Texas  Instruments  (Tl).  He  is  a  member  of  the  Defense  Science  Board,  and 
American  Defense  Preparedness  Association  Board  of  Directors.  His  organizational  unit  was 
awarded  the  Malcolm  Baldrige  National  Quality  Award  in  1 992.  Prior  to  his  current  position,  he 
helped  to  develop  the  STRIKE  and  HARPOON  missiles.  He  also  managed  and  directed  the 
HARM  program  at  Tl.  He  is  a  graduate  of  the  University  of  Missouri  with  BS  degrees  in  Me¬ 
chanical  and  Aeronautical  Engineering. 
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and  improvement  methodology  is  the  key 
in  fulfilling  customer  needs.  Michael  Por¬ 
ter  of  the  Harvard  Business  School,  quoted 
in  a  recent  Wall  Street  Journal  article  by 
William  M.  Bulkeley  says,  “Speed  has  be¬ 
come  crucial  to  getting  ahead  internation¬ 
ally.  It’s  gone  from  a  game  of  resources  to 
a  game  of  rate-of-progress.”  He  says, 
“Competition  today  is  a  race  to  improve.” 
In  his  article  he  quotes  Kim  Sheridan, 
chairman  of  Avalon  Software  Inc.,  a  Tuc¬ 
son,  AZ,  maker  of  software,  by  saying: 
“It’s  not  the  big  companies  that  eat  the 
small:  It’s  the  fast  that  eat  the  slow.”  The 
benefits  of  speed  are  becoming  more  and 
more  recognized  by  companies  in  America 
and  throughout  the  world. 

In  order  to  meet  critical  customer  needs 
of  reduced  cost  and  improved  quality,  they 
realized  a  key  methodology  in  achieving 
these  demands  lies  in  properly  reducing 
cycle  time.  By  evaluating  a  process, 
unrequired  tasks  can  be  identified  and  re¬ 
moved.  Some  examples  of  the  tasks  that 
are  undesirable  are  audits,  inspections, 
handoffs,  signature  approvals,  to  name  a 
few.  These  tasks  would  be  identified  as 
wasteful  steps,  non- value-added  curves  in 
a  road  or  deviations  in  a  straight  line  path. 
In  other  words  straighten  out  the  curves 
from  point  A  to  point  B. 

Merely  performing  the  same  process 
steps  faster — applying  automation,  em¬ 
ployee  overtime,  or  extended  shifts,  to 
mention  a  few  of  traditional  methodolo¬ 
gies — do  not  reduce  cost  or  improve  qual¬ 
ity.  These  actions  in  fact  drive  up  over¬ 
head,  add  cost,  and  do  little  to  address  our 
customers’  real  needs.  The  same  curves 
are  in  the  road. 

Although  this  methodology  may  pro¬ 
duce  products  faster,  it  overlooks  other  key 
competitive  ingredients  of  cost  and  qual¬ 


ity.  Cycle  time  improvements,  utilizing  the 
proper  methodology,  will  have  a  positive 
impact  on  cost  and  quality.  Eliyahu  M. 
Goldratt  states  in  his  book  The  Goal  that 
when  applying  the  theory  of  constraints, 
one  always  must  evaluate  critical  path 
items  and  perform  the  tradeoffs  that  best 
meet  customer  needs.  Be  very  careful  to 
seek  process  improvements  that  have  a  fa¬ 
vorable  impact  on  cycle  time,  quality,  and 
cost. 

For  example,  if  one  seeks  a  solution  that 
gets  us  quality  at  a  higher  cost,  it  is  not  a 
competitive  solution  (it  may  require  ad¬ 
ditional  capital,  more  inspections,  stretch¬ 
ing  cycle  time,  etc.).  Or,  if  one  arbitrarily 
reduces  cycle  time  (i.e.,  stops  inspection 
without  improving  the  process)  then  poor 
quality  will  be  passed  to  the  customer. 

Both  situations  will  increase  cost  or  loss 
of  customer  confidence. 

Using  the  proper  methodology  will  fa¬ 
vorably  effect  speed,  cost,  and  quality.  The 
proper  methodology  encompasses  all 
phases  of  the  product  need:  customer 
needs  (teaming),  and  manufacturability, 
teaming  with  all  skills  of  the  process: 

•  standardization, 

•  material, 

•  processes, 

•  simplicity  of  design,  reduction  of  part 
numbers  to  a  minimum, 

•  reusability, 

•  reuse  of  existing  designs, 

•  reuse  of  existing  manufacturing 
processes. 
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•  reuse  of  existing  test  equipment, 

•  reuse  of  existing  documentation  and 
plans, 

•  supplier  involvement  and  teaming  at 
the  earliest  point  of  product,  and 

•  combine  tasks  and  removation  of 
handoffs 

Texas  Instraments  is  striving  to  maxi¬ 
mize  design  standardization  and  strictly 
adhering  to  the  integration  of  these  pro¬ 
cesses  into  all  product  development 
phases.  Greater  emphasis  is  also  being 


placed  on  design  for  manufacturing  capa¬ 
bilities.  After  all,  if  a  product  is  not  going 
to  be  produced  and  used  by  a  customer 
why  develop  it  in  the  first  place?  Devel¬ 
opment  should  encompass  all  phases  of 
the  product  need. 

When  applying  the  proper  methodol¬ 
ogy  to  existing  processes  one  must  first 
truly  understand  the  existing  process. 
Mapping  the  current  process  is  critical  in 
identifying  all  the  curves  in  the  road.  Ar¬ 
rive  at  an  understanding  of  why  a  process 
either  needs  the  curves,  because  of  cur¬ 
rent  design,  or  establish  the  reason  for  re¬ 
moving  the  curves  from  the  process.  Pro¬ 
cess  standardization  will  enhance  cycles 
of  learning.  Companies  that  have  a  well- 


Figure  2.  Engineering  and  MRO  Materiai  Purchasing 
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integrated  design  standardization  focus 
will  tend  to  have  higher  value-added  pro¬ 
cesses.  The  processes  will  be  simpler,  thus 
reducing  variation  (higher  quality).  In 
other  words,  processes  which  require  in¬ 
dividual  “heroics”  have  a  greater  number 
of  curves,  higher  rate  of  variation  (lower 
quality).  Companies  that  have  a  well-in¬ 
tegrated  design  standardization  focus  will 
have  fewer  processes,  but  the  processes 
will  be  well  understood  and  will  be  much 
more  effective  in  meeting  the  customers 
needs.  Processes  that  are  determined  to  be 
best  in  class  will  be  used  and  are  improved 
over  time. 

Figure  2  shows  a  real-life  example  of 
redesigning  a  process  with  an  emphasis 


on  cycle  time.  The  figure  illustrates  the 
process  of  ordering  maintenance,  repair, 
operational  and  engineering  material.  The 
process  consisted  of  seventeen  steps.  The 
cost  was  $103  per  transaction  and  required 
a  cycle  time  of  four  to  six  weeks.  Upon 
reviewing  the  process  it  was  determined 
that  only  four  steps  were  required  to  meet 
customer  needs.  Figure  3  shows  the  re¬ 
vised  process  with  only  the  necessary 
steps.  The  revised  process  demonstrates  a 
cycle  time  for  engineering  material  of 
three  to  eight  days.  Maintenance,  repair, 
and  operational  material  currently  has  a 
cycle  time  of  one  day.  Transaction  costs 
have  been  reduced  to  less  than  $5  per 
transaction.  The  quality  level  consistently 
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Figure  3.  Express  Buy  Process 
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maintains  6  sigma. 

The  concept  is  relatively  simple;  re¬ 
move  the  inefficient  process  steps  and 
keep  the  steps  that  are  only  absolutely  re¬ 
quired  (value-added  steps).  Value  added 
steps  are  defined  as  steps  the  customer  is 
willing  to  pay  for.  Since  processes  don’t 
start  and  stop  neatly  at  functional  bound¬ 
aries,  the  process  usually  never  gets  opti¬ 
mized.  In  fact,  by  optimizing  a  given  func¬ 
tion  the  process  can,  in  many  cases,  de¬ 
grade  or  become  suboptimized. 

In  order  to  effectively  reduce  cycle 
time,  complete  processes  have  to  be  re¬ 
viewed,  not  just  functions.  Typically,  busi¬ 
nesses  are  organized  around  functions. 
This  is  called  a  hierarchical  functional  or¬ 
ganization.  Functional  organizations  work 
to  optimize  a  functional  expertise.  The  en¬ 
tire  recognition  and  reward  stracture  is  de¬ 
signed  around  creating  this  behavior.  In 
today’s  environment  of  speed,  this  bureau¬ 
cratic  culture  is  not  conducive  to  the  be¬ 
havior  required  for  incremental,  fast,  dy¬ 
namic,  ongoing  change  required  by 
today’s  customer. 

Industry  is  attacking  this  hierarchical 
culture  by  introducing  teaming  concepts. 
These  concepts  are  designed  to  give  busi¬ 
nesses  a  process  focus.  The  teaming  mod¬ 
els  are  designed  to  break  down  traditional 
organizational  boundaries  and  remold 
these  functions  into  skills  that  are  required 
by  the  process.  These  models  obviously 
attack  the  heart  and  soul  of  traditional 


management  practices.  Moving  a  com¬ 
pany  from  a  functional  improvement 
model  to  a  process  improvement  model  is 
a  key  in  reducing  the  wasted  motion  in¬ 
volved  in  producing  a  product.  Obtaining 
the  corporate  environment  that  will  enable 
diverse,  highly  skilled  people  to  focus  on 
establishing  and  im.proving  processes  that 
will  produce  products  that  truly  meet  cus¬ 
tomer  needs  is  vital. 

Great  athletic  teams  perform  with  flaw¬ 
less  precision,  very  little  wasted  motion, 
and  few  mistakes,  and  they  continue  to  ex¬ 
ceed  records  of  past  performance.  Indus¬ 
try,  by  better  applying  teaming  dynamics 
to  harness  the  workforce  when  they  apply 
the  proper  cycle  time  methodology,  can 
lift  customer  satisfaction  to  a  new  all  time 
high.  The  teaming  business  of  the  future 
must  learn  to  relish  change,  question  ev¬ 
erything,  think  outside  the  box,  and  never 
stop  learning.  Work  to  master  the  dynam¬ 
ics  of  creating  a  culture  advantageous  to 
teaming  and  empowerment.  The  success¬ 
ful  company  must  want  customers  to  be 
embarrassed  to  even  think  about  doing 
business  with  someone  else. 

Time  is  a  precious  commodity  and  has 
value.  It  is  there  every  time  a  new  product 
arrives  well  in  advance  of  the  competition. 
Applying  the  correct  methodology  of 
cycle  time,  cost,  and  quality  is  key  to  cus¬ 
tomer  satisfaction  and  product  success. 
The  bottom  line  is — blinding  speed  equals 
competitive  advantage! 
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process.  The  ARQ  is  a  refereed  journal, 
and  all  submissions  are  subject  to  a 
masked  review  that  ensures  an  impartial 
evaluation. 

Manuscripts  should  reflect  research  or 
empirically  supported  experience  in  an 
area  of  defense  acquisition.  Research, 
policy,  or  tutorial  articles  should  not  ex¬ 
ceed  4,500  words.  Opinion  pieces  should 
not  exceed  1,500  words. 

Authors  are  encouraged  to  seek  the  ad¬ 
vice  of  reference  librarians  in  drawing  up 
realistically  complete  citations  of  govern¬ 
ment  documents.  Standard  formulas  of 
citation  may  give  only  incomplete  infor¬ 
mation  in  reference  to  government  works; 
in  fact,  they  may  be  of  little  or  no  use. 
Helpful  guidance  is  also  available  in  Gar¬ 
ner,  D.  L.,  and  Smith,  D.  H.,  1993,  The 
complete  guide  to  citing  government  docu¬ 
ments:  a  manual  for  writers  and  librar¬ 
ians  (rev.ed.),  Bethesda,  MD;  Congres¬ 
sional  Information  Service,  Inc. 

The  ARQ  follows  the  author  (date)  form 
of  citation.  This  form  is  described  in  nu¬ 
merous  works,  including  the  Chicago 


Manual  of  Style  and  the  Publications 
Manual  of  the  American  Psychological 
Association.  Although  the  form  of  a  cita¬ 
tion  is  considerably  less  important  than  its 
completeness,  the  need  to  recast  citations 
submitted  in  other  forms  (e.g.,  footnotes 
or  endnotes)  will  delay  a  review  of  the 
work  in  which  they  appear. 

The  ARQ  is  a  publication  of  the  U.S. 
government  and  as  such  is  not  copy¬ 
righted.  Authors  of  copyrighted  works  and 
copyright  holders  of  works  for  hire  are 
strongly  encouraged  to  request  that  a  copy¬ 
right  notification  be  placed  on  their  pub¬ 
lished  work  as  a  safeguard  against  unin¬ 
tentional  infringement.  The  work  of  fed¬ 
eral  employees  undertaken  as  part  of  their 
official  duties  is  not,  of  course,  subject  to 
copyright. 

In  citing  the  work  of  others,  it  is  the 
author’s  responsibility  to  obtain  permis¬ 
sion  from  the  copyright  holder  if  the  pro¬ 
posed  use  exceeds  the  fair  use  provisions 
of  the  law  (see  U.S.  Government  Printing 
Office,  1994,  Circular  92:  Copyright  Law 
of  the  United  States  of  America,  p.  15, 
Washington,  DC:  Author).  Authors  will  be 
required  to  submit  a  copy  of  the  written 
permission  to  the  editor  before  publica¬ 
tion. 
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should  be  kept  simple.  Material  should  be 
doubled-spaced  and  organized  in  the  fol¬ 
lowing  order:  title  page,  abstract,  body, 
reference  list,  author’s  note,  and  figures 
or  tables.  Figures  and  tables  should  not 
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ing  the  text.  If  material  is  submitted  on  a 
computer  diskette,  each  figure  or  table 
should  be  recorded  in  a  separate  file  (pref¬ 
erably  .eps).  Authors  are  encouraged  to 
keep  the  text  and  (to  the  extent  possible) 
the  graphic  elements  of  their  manuscripts 
within  the  bounds  one  might  encounter  in 
using  a  standard  typewriter.  The  special 
typefaces  and  other  “graphic”  effects  now 
available  to  the  computer  user  must  be 
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leads  to  delay  in  publication  of  the  manu¬ 
script. 

The  author  (or  corresponding  author  in 
cases  of  multiple  authorship)  should  at¬ 
tach  to  the  manuscript  a  signed  cover  let¬ 
ter  that  provides  the  author’s  name,  ad¬ 
dress,  and  telephone  number.  The  letter 
should  also  verify  that  the  submission  is 
an  original  product  of  the  author,  that  it 


hasn’t  been  published  before,  and  that  it 
isn’t  under  consideration  by  another  pub¬ 
lication.  Details  about  the  manuscript  it¬ 
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DSMC  Press  (ARQ),  9820  Belvoir  Road, 
Suite  G38,  Fort  Belvoir,  VA  22060-5565. 
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received  within  48  hours  of  its  arrival. 
Following  an  initial  edit,  manuscripts  will 
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Editorial  Board  consideration. 
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